Jul 09 01:01:17 devstack cinder-volume[75972]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 01:01:17 devstack cinder-volume[75972]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 01:01:17 devstack cinder-volume[75972]: we strongly recommend against using it for new projects. Jul 09 01:01:17 devstack cinder-volume[75972]: If you are already using Eventlet, we recommend migrating to a different Jul 09 01:01:17 devstack cinder-volume[75972]: framework. For more detail see Jul 09 01:01:17 devstack cinder-volume[75972]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 01:01:17 devstack cinder-volume[75972]: import eventlet # noqa Jul 09 01:01:20 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:01:20 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:01:20 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:01:20 devstack cinder-volume[75972]: INFO dbcounter [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Registered counter for database cinder Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG dbcounter [-] [75972] Writer thread running {{(pid=75972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:01:21 devstack cinder-volume[75972]: INFO cinder.rpc [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 01:01:21 devstack cinder-volume[75972]: INFO cinder.rpc [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:01:21 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Determined volume DB was empty at startup. Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG cinder.volume.manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75972) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 01:01:21 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 01:01:21 devstack cinder-volume[75972]: WARNING stevedore.named [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 01:01:21 devstack cinder-volume[75972]: WARNING castellan.key_manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:01:21 devstack cinder-volume[75972]: WARNING cinder.keymgr.conf_key_mgr [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG cinder.volume.drivers.lvm [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75972) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 01:01:21 devstack cinder-volume[75972]: DEBUG oslo_concurrency.processutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_concurrency.processutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] CMD "cinder-rtstool verify" returned: 0 in 0.614s {{(pid=75972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:01:22 devstack cinder-volume[75972]: INFO cinder.rpc [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 01:01:22 devstack cinder-volume[75972]: INFO cinder.rpc [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 01:01:22 devstack cinder-volume[75972]: WARNING stevedore.named [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 01:01:22 devstack cinder-volume[75972]: WARNING castellan.key_manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:01:22 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:01:22 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Starting 1 workers Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Started child 76140 {{(pid=75972) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Full set of CONF: {{(pid=75972) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] ******************************************************************************** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Configuration options gathered from: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] ================================================================================ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] allow_availability_zone_fallback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] allow_compression_on_image_upload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] allowed_direct_url_schemes = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] api_rate_limit = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[76140]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] auth_strategy = keystone {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] az_cache_duration = 3600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_host = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_stats_polling_interval = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backup_api_class = cinder.backup.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backup_name_template = backup-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backup_use_same_host = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backup_use_temp_snapshot = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] chap_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_internal_tenant_project_id = cbad324c042c4d93b917c95b28fe87a4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_internal_tenant_user_id = aff93bd509ac4fac81b7ee0bc6610ba3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cloned_volume_same_az = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cluster = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] compression_format = gzip {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] compute_api_class = cinder.compute.nova.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] config_dir = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] config_source = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] control_exchange = openstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] debug = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] default_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] default_group_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] default_volume_type = lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_ssl_cert_verify = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] driver_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] enable_force_upload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] enable_new_services = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] enable_unsupported_driver = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] enabled_backends = ['lvmdriver-1'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] enforce_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_api_insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_api_ssl_compression = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_ca_certificates_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_catalog_info = image:glance:publicURL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_num_retries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance_request_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] graceful_shutdown_timeout = 5 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] group_api_class = cinder.group.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] host = devstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_compress_on_upload = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_conversion_address_space_limit = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_conversion_cpu_limit = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_conversion_disable = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_upload_use_cinder_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_upload_use_internal_tenant = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_volume_cache_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_volume_cache_max_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] image_volume_cache_max_size_gb = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] init_host_max_objects_retrieval = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] instance_format = [instance: %(uuid)s] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iscsi_target_flags = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iscsi_write_cache = on {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iser_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iser_ip_address = 192.168.122.226 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iser_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_color = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_config_append = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_options = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_rotate_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_rotate_interval_type = days {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] log_rotation_type = none {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] max_age = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] max_logfile_count = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] max_logfile_size_mb = 200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] max_over_subscription_ratio = 20.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] message_reap_interval = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] message_ttl = 2592000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] migration_create_volume_timeout_secs = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] monkey_patch = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] monkey_patch_modules = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] my_ip = 192.168.122.226 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] no_snapshot_gb_quota = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] num_iser_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] num_shell_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] num_volume_device_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] nvmeof_conn_info_version = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] nvmet_ns_id = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] nvmet_port_id = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_max_limit = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_ext_list = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_listen = 0.0.0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_listen_port = 8776 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] osapi_volume_workers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] per_volume_size_limit = -1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] periodic_fuzzy_delay = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] periodic_interval = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] project_id_regex = [0-9a-f\-]+ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] public_endpoint = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] publish_errors = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_backup_gigabytes = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_backups = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_gigabytes = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_groups = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_snapshots = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] quota_volumes = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] rate_limit_burst = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] rate_limit_except_level = CRITICAL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] rate_limit_interval = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] reinit_driver_count = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] report_discard_supported = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] report_interval = 120 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] reservation_clean_interval = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] reservation_expire = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] reserved_image_namespaces = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] reserved_percentage = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] rpc_response_timeout = 120 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] run_external_periodic_tasks = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] scst_target_driver = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_down_time = 720 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] shell_completion = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] snapshot_name_template = snapshot-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] snapshot_same_host = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] state_path = /opt/stack/data/cinder {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] storage_availability_zone = nova {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] storage_protocol = iSCSI {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] syslog_log_facility = LOG_USER {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_helper = lioadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_ip_address = 192.168.122.226 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] target_secondary_ip_addresses = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] transfer_api_class = cinder.transfer.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] transport_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] until_refresh = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_chap_auth = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_default_quota_class = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_journal = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_json = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_stderr = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] use_syslog = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] verify_glance_signatures = enabled {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_api_class = cinder.volume.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_clear_size = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_copy_bps_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_dd_blocksize = 1M {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_name_template = volume-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_service_inithost_offload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volume_usage_audit_period = month {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] zoning_mode = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_concurrency.disable_process_locking = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.auth_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.cache = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.delay_auth_decision = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.http_connect_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.include_service_catalog = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.interface = public {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_password = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcache_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.service_token_roles_required = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.service_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.token_cache_time = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.backend = dogpile.cache.null {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.backend_argument = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.backend_expiration_time = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.config_prefix = cache.oslo {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.debug_cache_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.enable_retry_client = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.enable_socket_keepalive = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.expiration_time = 600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.hashclient_retry_attempts = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_dead_retry = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_pool_maxsize = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_sasl_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.proxies = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.redis_db = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.redis_sentinel_service_name = mymaster {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.redis_server = localhost:6379 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.retry_attempts = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.retry_delay = 0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.socket_keepalive_count = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.socket_keepalive_idle = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.socket_keepalive_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.socket_timeout = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.tls_allowed_ciphers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.tls_cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.tls_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.tls_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.tls_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cache.username = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] coordination.backend_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.asyncio_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.asyncio_slave_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.backend = sqlalchemy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.connection_debug = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.connection_parameters = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.connection_recycle_time = 3600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.connection_trace = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.db_inc_retry_interval = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.db_max_retries = 20 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.db_max_retry_interval = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.db_retry_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.max_overflow = 50 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.max_pool_size = 5 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.max_retries = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.mysql_wsrep_sync_wait = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.pool_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.retry_interval = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.slave_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.sqlite_synchronous = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.synchronous_reader = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] database.use_db_reconnect = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.connection_string = messaging:// {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.es_doc_type = notification {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.es_scroll_size = 10000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.es_scroll_time = 2m {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.filter_error_trace = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.hmac_keys = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.sentinel_service_name = mymaster {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.socket_timeout = 0.1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.trace_requests = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler.trace_sqlalchemy = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler_jaeger.process_tags = {} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler_jaeger.service_name_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] profiler_otlp.service_name_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.enforce_new_defaults = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.enforce_scope = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.policy_default_rule = default {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.policy_file = policy.yaml {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_policy.remote_timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.group = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.helper_command = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] privsep_osbrick.user = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.group = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.helper_command = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] cinder_sys_admin.user = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.send_service_user_token = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] service_user.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] glance.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.chap_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.driver_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.enable_unsupported_driver = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.extra_capabilities = {} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iscsi_target_flags = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iscsi_write_cache = on {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iser_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iser_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.lvm_mirrors = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.lvm_share_target = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.lvm_type = auto {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.num_shell_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.nvmet_port_id = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.report_discard_supported = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.reserved_percentage = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.scst_target_driver = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.storage_protocol = iSCSI {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.unique_fqdn_network = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.use_chap_auth = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_clear_size = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volume_group = cinder-volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_reports.file_event_handler = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_reports.log_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.backend_host = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.chap_username = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.chiscsi_conf = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.driver_use_ssl = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.extra_capabilities = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iser_helper = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iser_ip_address = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iser_port = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.iser_target_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.lvm_conf_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.lvm_mirrors = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.lvm_share_target = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.lvm_type = auto {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.num_shell_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.nvmet_port_id = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.report_discard_supported = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.reserved_percentage = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.scst_target_driver = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.storage_protocol = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_helper = lioadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_ip_address = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.use_chap_auth = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_clear_size = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] lvmdriver-1.volumes_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.ssl_version = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_notifications.driver = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_notifications.retry = -1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] oslo_messaging_notifications.transport_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] key_manager.fixed_key = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.barbican_api_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.barbican_endpoint = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.barbican_endpoint_type = public {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.barbican_region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.number_of_retries = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.retry_delay = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.send_service_user_token = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.verify_ssl = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican.verify_ssl_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.auth_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] barbican_service_user.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.approle_role_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.approle_secret_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.kv_mountpoint = secret {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.kv_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.kv_version = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.root_token_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.ssl_ca_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:01:22 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] ******************************************************************************** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 01:01:23 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:23 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:23 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:23 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.671s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:01:23 devstack cinder-volume[76140]: INFO cinder.brick.local_dev.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:23 devstack sudo[76440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:23 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:24 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:24 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:24 devstack cinder-volume[76140]: DEBUG cinder.brick.local_dev.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76140) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 01:01:24 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:24 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:24 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:25 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.352s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:25 devstack sudo[76874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:25 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:26 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.733s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:26 devstack sudo[76925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 01:01:26 devstack sudo[76925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:27 devstack sudo[76925]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:27 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.702s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:27 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:27 devstack sudo[76930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:27 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:28 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:28 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:28 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:28 devstack sudo[76939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:28 devstack sudo[76939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:28 devstack sudo[76939]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:28 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:28 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:28 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:28 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:29 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:29 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.864s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:29 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:29 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:29 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:30 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:30 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:30 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:30 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:30 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:30 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:30 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:31 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.689s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:31 devstack cinder-volume[76140]: INFO cinder.volume.drivers.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:31 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:31 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:31 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.761s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:01:31 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:31 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:31 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:32 devstack cinder-volume[75972]: DEBUG dbcounter [-] [75972] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:01:32 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:32 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:32 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:32 devstack sudo[77090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:32 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:33 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:33 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:33 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:33 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:33 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:33 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:34 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:34 devstack cinder-volume[76140]: INFO cinder.volume.driver [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG cinder.volume.driver [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76140) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writer thread running {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG cinder.db.api [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Building query based on filter {{(pid=76140) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG cinder.image.image_utils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76140) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 01:01:34 devstack cinder-volume[76140]: INFO cinder.keymgr.migration [None req-da1c3517-a908-428a-bf6b-a9f6ab33c105 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:01:34 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:34 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:34 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:35 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:35 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:35 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:35 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:35 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:35 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:36 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:36 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:36 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:36 devstack sudo[77257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:36 devstack sudo[77257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:37 devstack sudo[77257]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:01:37 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Driver initialization completed successfully. Jul 09 01:01:37 devstack cinder-volume[76140]: INFO cinder.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Initiating service 2 cleanup Jul 09 01:01:37 devstack cinder-volume[76140]: INFO cinder.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Service 2 cleanup completed. Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG cinder.service [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Creating RPC server for service cinder-volume {{(pid=76140) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG cinder.service [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76140) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 01:01:37 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:01:37 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:37 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:01:37 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:38 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:38 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:38 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:38 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:38 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:38 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:38 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:38 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:38 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:01:38 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:39 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:39 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:39 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:01:39 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:01:39 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:01:40 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 09 01:01:40 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:01:40 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-5f3f62de-e33d-40de-98c3-3d765b2253e1 None None] Driver post RPC initialization completed successfully. Jul 09 01:01:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:01:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:02:01 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:02:01 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:02:01 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread info: [<_MainThread(MainThread, started 133115767136384)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:03:01 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:03:01 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:03:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:03:01 devstack sudo[79647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:03:01 devstack sudo[79647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:03:01 devstack sudo[79647]: pam_unix(sudo:session): session closed for user root Jul 09 01:03:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:03:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:03:01 devstack sudo[79650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:03:01 devstack sudo[79650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:03:02 devstack sudo[79650]: pam_unix(sudo:session): session closed for user root Jul 09 01:03:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:03:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:03:02 devstack sudo[79653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:03:02 devstack sudo[79653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:03:03 devstack sudo[79653]: pam_unix(sudo:session): session closed for user root Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:03:03 devstack sudo[79656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:03:03 devstack sudo[79656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:03:03 devstack sudo[79656]: pam_unix(sudo:session): session closed for user root Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:03:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread info: [<_MainThread(MainThread, started 133115767136384)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:03:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:03:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:04:01 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:04:01 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:04:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:04:01 devstack sudo[82632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:04:01 devstack sudo[82632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:04:01 devstack sudo[82632]: pam_unix(sudo:session): session closed for user root Jul 09 01:04:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:04:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:04:01 devstack sudo[82873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:04:01 devstack sudo[82873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:04:02 devstack sudo[82873]: pam_unix(sudo:session): session closed for user root Jul 09 01:04:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:04:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:04:02 devstack sudo[82898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:04:02 devstack sudo[82898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:04:03 devstack sudo[82898]: pam_unix(sudo:session): session closed for user root Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:04:03 devstack sudo[82920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:04:03 devstack sudo[82920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:04:03 devstack sudo[82920]: pam_unix(sudo:session): session closed for user root Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:04:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread info: [<_MainThread(MainThread, started 133115767136384)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:05:01 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:05:01 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:05:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:05:01 devstack sudo[84878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:05:01 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:05:01 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root Jul 09 01:05:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:05:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:05:01 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:05:01 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:05:02 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Jul 09 01:05:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:05:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:05:02 devstack sudo[84890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:05:02 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:05:03 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:05:03 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:05:03 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:05:03 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:05:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread info: [<_MainThread(MainThread, started 133115767136384)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:05:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:05:50 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:06:01 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:06:01 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 01:06:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:01 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 01:06:01 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:01 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:01 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:01 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:06:01 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:02 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:02 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:02 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 01:06:02 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:02 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Caught SIGTERM, stopping children Jul 09 01:06:02 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Acquiring lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:02 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Acquired lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:02 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Releasing lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:02 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Stop services. {{(pid=75972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 01:06:02 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Killing children. {{(pid=75972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 01:06:02 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Waiting on 1 children to exit Jul 09 01:06:03 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:03 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 01:06:03 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:03 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:06:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-8d824ea2-d92d-4d07-bd97-7d50305f9779 None None] thread info: [<_MainThread(MainThread, started 133115767136384)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:06:07 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 09 01:06:07 devstack cinder-volume[86241]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 01:06:07 devstack cinder-volume[86241]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 01:06:07 devstack cinder-volume[86241]: we strongly recommend against using it for new projects. Jul 09 01:06:07 devstack cinder-volume[86241]: If you are already using Eventlet, we recommend migrating to a different Jul 09 01:06:07 devstack cinder-volume[86241]: framework. For more detail see Jul 09 01:06:07 devstack cinder-volume[86241]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 01:06:07 devstack cinder-volume[86241]: import eventlet # noqa Jul 09 01:06:09 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:09 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:09 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:10 devstack cinder-volume[86241]: INFO dbcounter [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Registered counter for database cinder Jul 09 01:06:10 devstack cinder-volume[86241]: DEBUG oslo_db.sqlalchemy.engines [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG dbcounter [-] [86241] Writer thread running {{(pid=86241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:06:11 devstack cinder-volume[86241]: INFO cinder.rpc [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 01:06:11 devstack cinder-volume[86241]: INFO cinder.rpc [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_db.sqlalchemy.engines [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:11 devstack cinder-volume[86241]: INFO cinder.volume.manager [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Determined volume DB was empty at startup. Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG cinder.volume.manager [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86241) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 01:06:11 devstack cinder-volume[86241]: INFO cinder.volume.manager [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 01:06:11 devstack cinder-volume[86241]: WARNING stevedore.named [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 01:06:11 devstack cinder-volume[86241]: WARNING castellan.key_manager [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:06:11 devstack cinder-volume[86241]: WARNING cinder.keymgr.conf_key_mgr [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:06:11 devstack cinder-volume[86241]: INFO cinder.volume.manager [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_db.sqlalchemy.engines [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:11 devstack cinder-volume[86241]: INFO oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Starting 1 workers Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Started child 86486 {{(pid=86241) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Full set of CONF: {{(pid=86241) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] ******************************************************************************** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Configuration options gathered from: {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] ================================================================================ {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] allow_availability_zone_fallback = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] allow_compression_on_image_upload = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] allowed_direct_url_schemes = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] api_rate_limit = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] auth_strategy = keystone {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_availability_zone = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_host = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_stats_polling_interval = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backup_api_class = cinder.backup.api.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backup_name_template = backup-%s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backup_use_same_host = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backup_use_temp_snapshot = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] chap_password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] chap_username = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_internal_tenant_project_id = cbad324c042c4d93b917c95b28fe87a4 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_internal_tenant_user_id = aff93bd509ac4fac81b7ee0bc6610ba3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cluster = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] compression_format = gzip {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] compute_api_class = cinder.compute.nova.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] config_dir = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] config_source = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] control_exchange = openstack {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] debug = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] default_availability_zone = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] default_group_type = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86486]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] default_volume_type = QuobyteHD {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] disk_geometry = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_client_cert = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_client_cert_key = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_data_namespace = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_ssl_cert_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_ssl_cert_verify = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] driver_use_ssl = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] enable_new_services = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] enable_unsupported_driver = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] enabled_backends = ['QuobyteHD'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] enforce_multipath_for_image_xfer = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] filter_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_api_insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_api_ssl_compression = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_ca_certificates_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_catalog_info = image:glance:publicURL {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_num_retries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance_request_timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] goodness_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] graceful_shutdown_timeout = 5 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] group_api_class = cinder.group.api.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] host = devstack {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_compress_on_upload = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_conversion_address_space_limit = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_conversion_cpu_limit = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_conversion_disable = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_upload_use_cinder_backend = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_upload_use_internal_tenant = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_volume_cache_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_volume_cache_max_count = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] image_volume_cache_max_size_gb = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] init_host_max_objects_retrieval = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] instance_format = [instance: %(uuid)s] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iscsi_target_flags = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iscsi_write_cache = on {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iser_helper = tgtadm {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iser_ip_address = 192.168.122.226 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iser_port = 3260 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_color = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_config_append = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_dir = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_options = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_rotate_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_rotate_interval_type = days {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] log_rotation_type = none {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] max_age = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] max_logfile_count = 30 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] max_logfile_size_mb = 200 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] max_over_subscription_ratio = 20.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] message_reap_interval = 86400 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] message_ttl = 2592000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] migration_create_volume_timeout_secs = 300 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] monkey_patch = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] monkey_patch_modules = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] my_ip = 192.168.122.226 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] no_snapshot_gb_quota = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] num_iser_scan_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] num_shell_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] num_volume_device_scan_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] nvmeof_conn_info_version = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] nvmet_ns_id = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] nvmet_port_id = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_max_limit = 1000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_ext_list = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_listen_port = 8776 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_use_ssl = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] osapi_volume_workers = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] per_volume_size_limit = -1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] periodic_fuzzy_delay = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] periodic_interval = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] public_endpoint = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] publish_errors = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_backup_gigabytes = 1000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_backups = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_gigabytes = 1000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_groups = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_snapshots = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] quota_volumes = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] rate_limit_burst = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] rate_limit_except_level = CRITICAL {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] rate_limit_interval = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] reinit_driver_count = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] replication_device = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] report_discard_supported = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] report_interval = 120 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] reservation_clean_interval = 86400 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] reservation_expire = 86400 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] reserved_image_namespaces = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] reserved_percentage = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] rpc_response_timeout = 120 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] run_external_periodic_tasks = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] scst_target_driver = iscsi {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] scst_target_iqn_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_down_time = 720 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] shell_completion = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] snapshot_name_template = snapshot-%s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] split_loggers = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] state_path = /opt/stack/data/cinder {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] storage_availability_zone = nova {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] storage_protocol = iSCSI {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] syslog_log_facility = LOG_USER {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_helper = lioadm {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_ip_address = 192.168.122.226 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_port = 3260 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_protocol = iscsi {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] target_secondary_ip_addresses = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] trace_flags = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] transport_url = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] until_refresh = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_chap_auth = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_default_quota_class = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_journal = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_json = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_multipath_for_image_xfer = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_stderr = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] use_syslog = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] verify_glance_signatures = enabled {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_api_class = cinder.volume.api.API {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_backend_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_clear = zero {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_clear_ionice = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_clear_size = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_copy_bps_limit = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_dd_blocksize = 1M {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_name_template = volume-%s {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_service_inithost_offload = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volume_usage_audit_period = month {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.remotefs [None req-0469abe6-0194-4417-aba2-083970ed135e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86486) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] zoning_mode = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_concurrency.disable_process_locking = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.auth_section = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.auth_type = password {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.auth_version = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.cache = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.include_service_catalog = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.interface = public {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_password = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcache_username = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.region_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.service_type = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.backend = dogpile.cache.null {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.backend_argument = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.backend_expiration_time = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.config_prefix = cache.oslo {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.debug_cache_backend = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.enable_retry_client = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.enable_socket_keepalive = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.expiration_time = 600 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.hashclient_retry_attempts = 2 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_dead_retry = 300 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_pool_maxsize = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_sasl_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.proxies = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.redis_db = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.redis_server = localhost:6379 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.retry_attempts = 2 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.retry_delay = 0.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.socket_keepalive_count = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.socket_keepalive_idle = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.socket_keepalive_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.socket_timeout = 1.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.tls_allowed_ciphers = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.tls_cafile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.tls_certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.tls_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.tls_keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cache.username = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] coordination.backend_url = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.asyncio_connection = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.asyncio_slave_connection = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.backend = sqlalchemy {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.connection = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.connection_debug = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.connection_parameters = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.connection_recycle_time = 3600 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.connection_trace = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.db_inc_retry_interval = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.db_max_retries = 20 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.db_max_retry_interval = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.db_retry_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.max_overflow = 50 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.max_pool_size = 5 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.max_retries = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.mysql_wsrep_sync_wait = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.pool_timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.retry_interval = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.slave_connection = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.sqlite_synchronous = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.synchronous_reader = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] database.use_db_reconnect = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.connection_string = messaging:// {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.es_doc_type = notification {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.es_scroll_size = 10000 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.es_scroll_time = 2m {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.filter_error_trace = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.hmac_keys = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.sentinel_service_name = mymaster {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.socket_timeout = 0.1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.trace_requests = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler.trace_sqlalchemy = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler_jaeger.process_tags = {} {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler_jaeger.service_name_prefix = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] profiler_otlp.service_name_prefix = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.enforce_new_defaults = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.enforce_scope = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.policy_default_rule = default {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.policy_file = policy.yaml {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.group = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.helper_command = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] privsep_osbrick.user = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.group = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.helper_command = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] cinder_sys_admin.user = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.auth_section = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.auth_type = password {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.cafile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.collect_timing = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.send_service_user_token = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.split_loggers = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] service_user.timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.auth_section = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.auth_type = password {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.collect_timing = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.region_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.split_loggers = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] glance.timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.backend_availability_zone = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.chap_password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.chap_username = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.disk_geometry = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_client_cert = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_client_cert_key = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_data_namespace = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.driver_use_ssl = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.extra_capabilities = {} {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.filter_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.goodness_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iscsi_target_flags = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iscsi_write_cache = on {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iser_helper = tgtadm {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iser_port = 3260 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_host = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_login = admin {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_mount_options = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_private_key = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_share_path = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.num_shell_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.quobyte_volume_url = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.replication_device = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.report_discard_supported = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.reserved_percentage = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_helper = tgtadm {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_port = 3260 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_protocol = iscsi {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.trace_flags = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.unique_fqdn_network = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.use_chap_auth = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_backend_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_clear = zero {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_clear_ionice = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_clear_size = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_reports.file_event_handler = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_reports.log_dir = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.backend_availability_zone = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.backend_host = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.chap_password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.chap_username = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.chiscsi_conf = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.disk_geometry = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_client_cert = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_data_namespace = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.driver_use_ssl = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.extra_capabilities = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.filter_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.goodness_function = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iser_helper = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iser_ip_address = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iser_port = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.iser_target_prefix = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_host = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_login = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_mount_options = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_password = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_private_key = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_share_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_ssh_port = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.num_shell_tries = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.nvmet_port_id = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.replication_device = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.report_discard_supported = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.reserved_percentage = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.scst_target_driver = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.storage_protocol = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_helper = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_ip_address = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_port = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86486) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_prefix = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_protocol = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86486]: WARNING cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.trace_flags = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86486]: WARNING cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.use_chap_auth = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_clear = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_clear_size = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] QuobyteHD.volumes_dir = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Running cmd (subprocess): mount.quobyte {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_notifications.driver = [] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_notifications.retry = -1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] key_manager.fixed_key = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.barbican_api_version = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.barbican_endpoint = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.barbican_endpoint_type = public {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.barbican_region_name = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.cafile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.collect_timing = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.number_of_retries = 60 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.retry_delay = 1 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.send_service_user_token = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.split_loggers = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.verify_ssl = True {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican.verify_ssl_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.auth_section = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.auth_type = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.cafile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.certfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.collect_timing = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.insecure = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.keyfile = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.split_loggers = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] barbican_service_user.timeout = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.approle_role_id = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.approle_secret_id = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.kv_mountpoint = secret {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.kv_path = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.kv_version = 2 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.namespace = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.root_token_id = **** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.ssl_ca_crt_file = None {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.timeout = 60.0 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.use_ssl = False {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:11 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] ******************************************************************************** {{(pid=86241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 01:06:11 devstack quobyte-client[86498]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 01:06:11 devstack quobyte-client[86498]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:11 devstack cinder-volume[86486]: INFO cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 ... Jul 09 01:06:11 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 -c /etc/quobyte/client-cinder.cfg {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:11 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 -c /etc/quobyte/client-cinder.cfg Jul 09 01:06:11 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:12 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:12 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:12 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:12 devstack cinder-volume[76140]: WARNING amqp [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 01:06:12 devstack cinder-volume[76140]: WARNING amqp [None req-8476bb3d-df20-45ff-88d1-cb16d573cedb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 01:06:12 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:12 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.876s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:12 devstack cinder-volume[86486]: INFO cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 succeeded Jul 09 01:06:12 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:12 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.895s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:12 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:12 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:12 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:13 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:13 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.055s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:13 devstack cinder-volume[86486]: INFO cinder.volume.driver [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Driver hasn't implemented _init_vendor_properties() Jul 09 01:06:13 devstack cinder-volume[86486]: DEBUG cinder.volume.driver [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545356750488, 'free_capacity_gb': 1775.7545356750488, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86486) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 01:06:13 devstack cinder-volume[86486]: DEBUG oslo_db.sqlalchemy.engines [None req-0469abe6-0194-4417-aba2-083970ed135e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG dbcounter [-] [86486] Writer thread running {{(pid=86486) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.db.api [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Building query based on filter {{(pid=86486) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.image.image_utils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86486) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 01:06:14 devstack cinder-volume[86486]: INFO cinder.keymgr.migration [None req-4dfac32e-2672-49cc-88f0-7afdf2188c50 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:14 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:14 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:14 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.804s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Notifying Schedulers of capabilities ... {{(pid=86486) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:06:14 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Driver initialization completed successfully. Jul 09 01:06:14 devstack cinder-volume[86486]: INFO cinder.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Initiating service 3 cleanup Jul 09 01:06:14 devstack cinder-volume[86486]: INFO cinder.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Service 3 cleanup completed. Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.service [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Creating RPC server for service cinder-volume {{(pid=86486) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 01:06:14 devstack cinder-volume[86486]: DEBUG cinder.service [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86486) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 01:06:15 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86486) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG cinder.volume.drivers.quobyte [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86486) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86486) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:15 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:15 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:16 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:16 devstack cinder-volume[86486]: DEBUG oslo_concurrency.processutils [None req-0469abe6-0194-4417-aba2-083970ed135e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.959s {{(pid=86486) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:16 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-0469abe6-0194-4417-aba2-083970ed135e None None] Driver post RPC initialization completed successfully. Jul 09 01:06:16 devstack cinder-volume[86241]: INFO oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Caught SIGTERM, stopping children Jul 09 01:06:16 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Acquiring lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:16 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Acquired lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:16 devstack cinder-volume[86241]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Releasing lock "singleton_lock" {{(pid=86241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:16 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Stop services. {{(pid=86241) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 01:06:16 devstack cinder-volume[86241]: DEBUG oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Killing children. {{(pid=86241) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 01:06:16 devstack cinder-volume[86241]: INFO oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Waiting on 1 children to exit Jul 09 01:06:17 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Acquiring lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:17 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Acquired lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:17 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Releasing lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:17 devstack cinder-volume[86486]: WARNING amqp [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 01:06:17 devstack cinder-volume[86486]: WARNING amqp [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 01:06:17 devstack cinder-volume[86241]: INFO oslo_service.backend._eventlet.service [None req-2c45e3cc-e75b-4278-973f-47010af1d8cc None None] Child 86486 exited with status 0 Jul 09 01:06:17 devstack cinder-volume[86871]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 01:06:17 devstack cinder-volume[86871]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 01:06:17 devstack cinder-volume[86871]: we strongly recommend against using it for new projects. Jul 09 01:06:17 devstack cinder-volume[86871]: If you are already using Eventlet, we recommend migrating to a different Jul 09 01:06:17 devstack cinder-volume[86871]: framework. For more detail see Jul 09 01:06:17 devstack cinder-volume[86871]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 01:06:17 devstack cinder-volume[86871]: import eventlet # noqa Jul 09 01:06:19 devstack cinder-volume[86871]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 01:06:19 devstack cinder-volume[86871]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 01:06:19 devstack cinder-volume[86871]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 01:06:20 devstack cinder-volume[86871]: INFO dbcounter [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Registered counter for database cinder Jul 09 01:06:20 devstack cinder-volume[86871]: DEBUG oslo_db.sqlalchemy.engines [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG dbcounter [-] [86871] Writer thread running {{(pid=86871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:06:21 devstack cinder-volume[86871]: INFO cinder.rpc [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 01:06:21 devstack cinder-volume[86871]: INFO cinder.rpc [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_db.sqlalchemy.engines [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:21 devstack cinder-volume[86871]: INFO cinder.volume.manager [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Determined volume DB was empty at startup. Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG cinder.volume.manager [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86871) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 01:06:21 devstack cinder-volume[86871]: WARNING stevedore.named [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 01:06:21 devstack cinder-volume[86871]: WARNING castellan.key_manager [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:06:21 devstack cinder-volume[86871]: WARNING cinder.keymgr.conf_key_mgr [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 01:06:21 devstack cinder-volume[86871]: INFO cinder.volume.manager [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_db.sqlalchemy.engines [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:21 devstack cinder-volume[86871]: INFO oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Starting 1 workers Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Started child 86954 {{(pid=86871) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Full set of CONF: {{(pid=86871) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] ******************************************************************************** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] Configuration options gathered from: {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] ================================================================================ {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] allow_availability_zone_fallback = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] allow_compression_on_image_upload = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] allowed_direct_url_schemes = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86954]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] api_rate_limit = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] auth_strategy = keystone {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_availability_zone = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_host = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_stats_polling_interval = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backup_api_class = cinder.backup.api.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backup_name_template = backup-%s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backup_use_same_host = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backup_use_temp_snapshot = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] chap_password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] chap_username = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_internal_tenant_project_id = cbad324c042c4d93b917c95b28fe87a4 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_internal_tenant_user_id = aff93bd509ac4fac81b7ee0bc6610ba3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cluster = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] compression_format = gzip {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] compute_api_class = cinder.compute.nova.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] config_dir = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] config_source = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] control_exchange = openstack {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] debug = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] default_availability_zone = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] default_group_type = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] default_volume_type = QuobyteHD {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] disk_geometry = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_client_cert = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_client_cert_key = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_data_namespace = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_ssl_cert_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_ssl_cert_verify = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] driver_use_ssl = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] enable_new_services = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] enable_unsupported_driver = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] enabled_backends = ['QuobyteHD'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] enforce_multipath_for_image_xfer = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] filter_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_api_insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_api_servers = ['http://192.168.122.226/image'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_api_ssl_compression = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_ca_certificates_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_catalog_info = image:glance:publicURL {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_num_retries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance_request_timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] goodness_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] graceful_shutdown_timeout = 5 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] group_api_class = cinder.group.api.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] host = devstack {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_compress_on_upload = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_conversion_address_space_limit = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_conversion_cpu_limit = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_conversion_disable = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_upload_use_cinder_backend = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_upload_use_internal_tenant = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_volume_cache_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_volume_cache_max_count = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] image_volume_cache_max_size_gb = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] init_host_max_objects_retrieval = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] instance_format = [instance: %(uuid)s] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iscsi_target_flags = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iscsi_write_cache = on {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iser_helper = tgtadm {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iser_ip_address = 192.168.122.226 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iser_port = 3260 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86954) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_color = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_config_append = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_dir = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_options = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_rotate_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_rotate_interval_type = days {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] log_rotation_type = none {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] max_age = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] max_logfile_count = 30 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] max_logfile_size_mb = 200 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] max_over_subscription_ratio = 20.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] message_reap_interval = 86400 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] message_ttl = 2592000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] migration_create_volume_timeout_secs = 300 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] monkey_patch = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] monkey_patch_modules = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] my_ip = 192.168.122.226 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] no_snapshot_gb_quota = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] num_iser_scan_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] num_shell_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] num_volume_device_scan_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] nvmeof_conn_info_version = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] nvmet_ns_id = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] nvmet_port_id = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_max_limit = 1000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_ext_list = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_listen = 0.0.0.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_listen_port = 8776 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_use_ssl = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] osapi_volume_workers = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] per_volume_size_limit = -1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] periodic_fuzzy_delay = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] periodic_interval = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] project_id_regex = [0-9a-f\-]+ {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] public_endpoint = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] publish_errors = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_backup_gigabytes = 1000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_backups = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_gigabytes = 1000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_groups = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_snapshots = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] quota_volumes = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] rate_limit_burst = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] rate_limit_except_level = CRITICAL {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] rate_limit_interval = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] reinit_driver_count = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] replication_device = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] report_discard_supported = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] report_interval = 120 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] reservation_clean_interval = 86400 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] reservation_expire = 86400 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] reserved_image_namespaces = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] reserved_percentage = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] rpc_response_timeout = 120 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] run_external_periodic_tasks = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] scst_target_driver = iscsi {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] scst_target_iqn_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_down_time = 720 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] shell_completion = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] snapshot_name_template = snapshot-%s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] split_loggers = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] state_path = /opt/stack/data/cinder {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] storage_availability_zone = nova {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] storage_protocol = iSCSI {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] syslog_log_facility = LOG_USER {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_helper = lioadm {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_ip_address = 192.168.122.226 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_port = 3260 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_protocol = iscsi {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] target_secondary_ip_addresses = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] trace_flags = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] transfer_api_class = cinder.transfer.api.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] transport_url = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] until_refresh = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_chap_auth = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_default_quota_class = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_journal = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_json = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_multipath_for_image_xfer = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_stderr = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] use_syslog = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] verify_glance_signatures = enabled {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_api_class = cinder.volume.api.API {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_backend_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_clear = zero {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_clear_ionice = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_clear_size = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_copy_bps_limit = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_dd_blocksize = 1M {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_name_template = volume-%s {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_service_inithost_offload = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volume_usage_audit_period = month {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] zoning_mode = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_concurrency.disable_process_locking = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.auth_section = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.auth_type = password {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.auth_version = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.cache = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.include_service_catalog = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.interface = public {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_password = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcache_username = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.region_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.service_token_roles_required = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.service_type = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.226/identity {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.backend = dogpile.cache.null {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.backend_argument = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.backend_expiration_time = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.config_prefix = cache.oslo {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.debug_cache_backend = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86954) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 01:06:21 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 01:06:21 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.enable_retry_client = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.enable_socket_keepalive = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.expiration_time = 600 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.hashclient_retry_attempts = 2 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_dead_retry = 300 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_pool_maxsize = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_sasl_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Running cmd (subprocess): mount.quobyte {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.proxies = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.redis_db = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.redis_server = localhost:6379 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.retry_attempts = 2 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.retry_delay = 0.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.socket_keepalive_count = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.socket_keepalive_idle = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.socket_keepalive_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.socket_timeout = 1.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.tls_allowed_ciphers = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.tls_cafile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.tls_certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.tls_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.tls_keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cache.username = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] coordination.backend_url = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.asyncio_connection = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.asyncio_slave_connection = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.backend = sqlalchemy {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.connection = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.connection_debug = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.connection_parameters = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.connection_recycle_time = 3600 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.connection_trace = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.db_inc_retry_interval = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.db_max_retries = 20 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.db_max_retry_interval = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.db_retry_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.max_overflow = 50 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.max_pool_size = 5 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.max_retries = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.mysql_wsrep_sync_wait = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.pool_timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.retry_interval = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.slave_connection = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.sqlite_synchronous = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.synchronous_reader = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] database.use_db_reconnect = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.connection_string = messaging:// {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.es_doc_type = notification {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.es_scroll_size = 10000 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.es_scroll_time = 2m {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.filter_error_trace = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.hmac_keys = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.sentinel_service_name = mymaster {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.socket_timeout = 0.1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.trace_requests = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler.trace_sqlalchemy = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler_jaeger.process_tags = {} {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler_jaeger.service_name_prefix = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] profiler_otlp.service_name_prefix = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.enforce_new_defaults = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.enforce_scope = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.policy_default_rule = default {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.policy_file = policy.yaml {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_policy.remote_timeout = 60.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.group = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.helper_command = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] privsep_osbrick.user = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.group = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.helper_command = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] cinder_sys_admin.user = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.auth_section = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.auth_type = password {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.cafile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.collect_timing = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.send_service_user_token = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.split_loggers = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] service_user.timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.auth_section = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.auth_type = password {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.collect_timing = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.region_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.split_loggers = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] glance.timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.backend_availability_zone = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.chap_password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.chap_username = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.disk_geometry = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_client_cert = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_client_cert_key = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_data_namespace = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.driver_use_ssl = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.extra_capabilities = {} {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.filter_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.goodness_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iscsi_target_flags = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iscsi_write_cache = on {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iser_helper = tgtadm {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iser_port = 3260 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_host = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_login = admin {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_mount_options = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_private_key = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_share_path = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_ssh_port = 22 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.num_shell_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_client_cfg = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack quobyte-client[86958]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.quobyte_volume_url = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.replication_device = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.report_discard_supported = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.reserved_percentage = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack quobyte-client[86958]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_helper = tgtadm {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_port = 3260 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_protocol = iscsi {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.trace_flags = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.unique_fqdn_network = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.use_chap_auth = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_backend_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_clear = zero {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_clear_ionice = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_clear_size = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_reports.file_event_handler = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_reports.log_dir = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.backend_availability_zone = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.backend_host = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.chap_password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.chap_username = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.chiscsi_conf = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.disk_geometry = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_client_cert = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_client_cert_key = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_data_namespace = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.driver_use_ssl = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.extra_capabilities = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.filter_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.goodness_function = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iscsi_target_flags = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iscsi_write_cache = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iser_helper = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iser_ip_address = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iser_port = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.iser_target_prefix = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_host = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_login = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_mount_options = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_password = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_private_key = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_share_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_ssh_port = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.num_shell_tries = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nvmet_ns_id = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.nvmet_port_id = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.replication_device = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.report_discard_supported = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.reserved_percentage = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.scst_target_driver = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.storage_protocol = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_helper = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_ip_address = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_port = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_prefix = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_protocol = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.trace_flags = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.unique_fqdn_network = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.use_chap_auth = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_clear = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_clear_ionice = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_clear_size = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] QuobyteHD.volumes_dir = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_notifications.driver = [] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_notifications.retry = -1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] key_manager.fixed_key = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.barbican_api_version = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.barbican_endpoint = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.barbican_endpoint_type = public {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.barbican_region_name = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.cafile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.collect_timing = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.number_of_retries = 60 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.retry_delay = 1 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.send_service_user_token = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.split_loggers = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.verify_ssl = True {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican.verify_ssl_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.auth_section = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.auth_type = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.cafile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.certfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.collect_timing = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.insecure = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.keyfile = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.split_loggers = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] barbican_service_user.timeout = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.approle_role_id = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.approle_secret_id = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.kv_mountpoint = secret {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.kv_path = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.kv_version = 2 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.namespace = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.root_token_id = **** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.ssl_ca_crt_file = None {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.timeout = 60.0 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.use_ssl = False {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 01:06:21 devstack cinder-volume[86871]: DEBUG oslo_service.backend._eventlet.service [None req-9dff3cc8-0ce5-445e-88d5-1484271de7bf None None] ******************************************************************************** {{(pid=86871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 01:06:22 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.631s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:22 devstack cinder-volume[86954]: INFO cinder.volume.driver [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Driver hasn't implemented _init_vendor_properties() Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.volume.driver [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545356750488, 'free_capacity_gb': 1775.7545356750488, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86954) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writer thread running {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.db.api [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Building query based on filter {{(pid=86954) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86954) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:22 devstack cinder-volume[86954]: INFO cinder.keymgr.migration [None req-0e76fbfb-dbb4-4752-b2a5-e11320e626f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 01:06:22 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:22 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.642s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:22 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:06:22 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Driver initialization completed successfully. Jul 09 01:06:22 devstack cinder-volume[86954]: INFO cinder.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Initiating service 3 cleanup Jul 09 01:06:23 devstack cinder-volume[86954]: INFO cinder.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Service 3 cleanup completed. Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG cinder.service [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Creating RPC server for service cinder-volume {{(pid=86954) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG cinder.service [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86954) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 01:06:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:06:23 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:06:23 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:06:23 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Jul 09 01:06:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.644s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:06:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3c9d21f3-b0c3-4323-9164-cf054e9ab74a None None] Driver post RPC initialization completed successfully. Jul 09 01:06:31 devstack cinder-volume[86871]: DEBUG dbcounter [-] [86871] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:06:33 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:06:33 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=4 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:06:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:06:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 6 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:06:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:07:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:07:33 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:07:33 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:07:34 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Jul 09 01:07:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.612s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:07:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:07:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:07:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 6 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:07:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:08:33 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:08:33 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:08:33 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:08:34 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Jul 09 01:08:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.741s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:08:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:08:50 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Flow 'volume_create_manager' (361c9346-f129-4eed-b02d-4638da7a65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b62277c-4911-44f4-90e6-0cef2ee6d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b62277c-4911-44f4-90e6-0cef2ee6d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427009316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f07350-57ee-4ef1-a85e-8488c2afce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923e93735364461aa0175cfc4020a3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:08:51Z,use_quota=True,user_id='ff3f6cfea27e423f804f35fa62897d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784c9bdb-dc52-453e-8ab6-11aa25f4ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784c9bdb-dc52-453e-8ab6-11aa25f4ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550ece3c-2239-44b1-b4a5-31fa7f4a7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550ece3c-2239-44b1-b4a5-31fa7f4a7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f07350-57ee-4ef1-a85e-8488c2afce8f', 'volume_name': 'volume-94f07350-57ee-4ef1-a85e-8488c2afce8f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8820fc79-f065-4d26-87fb-c8f1d43e038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8820fc79-f065-4d26-87fb-c8f1d43e038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a98e59-83e8-48ab-9936-82ccb1f5ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:51 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Volume 94f07350-57ee-4ef1-a85e-8488c2afce8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f07350-57ee-4ef1-a85e-8488c2afce8f', 'volume_size': 1} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427009316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f07350-57ee-4ef1-a85e-8488c2afce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923e93735364461aa0175cfc4020a3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:08:51Z,use_quota=True,user_id='ff3f6cfea27e423f804f35fa62897d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Creating volume 94f07350-57ee-4ef1-a85e-8488c2afce8f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:08:51 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:08:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:08:51 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f 1073741824 Jul 09 01:08:51 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:08:52 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Jul 09 01:08:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f 1073741824" returned: 0 in 1.127s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:08:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:08:52 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f Jul 09 01:08:52 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:08:53 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f" returned: 0 in 0.717s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a98e59-83e8-48ab-9936-82ccb1f5ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f07350-57ee-4ef1-a85e-8488c2afce8f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7543b725-bfd6-4d43-a076-c0bda28bb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:08:53 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Volume volume-94f07350-57ee-4ef1-a85e-8488c2afce8f (94f07350-57ee-4ef1-a85e-8488c2afce8f): created successfully Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7543b725-bfd6-4d43-a076-c0bda28bb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:08:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Flow 'volume_create_manager' (361c9346-f129-4eed-b02d-4638da7a65c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:08:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a10c481e-5799-4ebd-bad1-e46884e7b27d tempest-TaggedAttachmentsTest-1286207677 None] Created volume successfully. Jul 09 01:09:03 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:09:03 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Flow 'volume_create_manager' (1a75bb46-8273-4501-be22-c6ac67c5ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fca28e8-ed47-48e9-881c-a3e39b91662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fca28e8-ed47-48e9-881c-a3e39b91662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-263231034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d415fd-36e0-46e8-8c65-f058265af151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c67ae68109b44288ee905a156a68eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:09:23Z,use_quota=True,user_id='5c84cb07a5b4488e89a847b1788bb8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38deada-ba3a-4fdf-b294-7fd35c9f1c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38deada-ba3a-4fdf-b294-7fd35c9f1c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da277a65-19bf-4190-9c90-0fb39c8f5b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da277a65-19bf-4190-9c90-0fb39c8f5b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d415fd-36e0-46e8-8c65-f058265af151', 'volume_name': 'volume-31d415fd-36e0-46e8-8c65-f058265af151', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb56f74e-c6b1-4c55-8f34-9e7bc3cdc6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb56f74e-c6b1-4c55-8f34-9e7bc3cdc6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe411e-f759-442d-b863-a8f5d4242bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Volume 31d415fd-36e0-46e8-8c65-f058265af151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d415fd-36e0-46e8-8c65-f058265af151', 'volume_size': 1} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-263231034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d415fd-36e0-46e8-8c65-f058265af151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c67ae68109b44288ee905a156a68eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:09:23Z,use_quota=True,user_id='5c84cb07a5b4488e89a847b1788bb8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Creating volume 31d415fd-36e0-46e8-8c65-f058265af151 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:09:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:09:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:23 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 1073741824 Jul 09 01:09:23 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:24 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 1073741824" returned: 0 in 1.347s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:25 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 Jul 09 01:09:25 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:26 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151" returned: 0 in 1.211s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] <== create_volume: return (2650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe411e-f759-442d-b863-a8f5d4242bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d415fd-36e0-46e8-8c65-f058265af151', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f919f28-8843-4701-9def-ceb13337a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Volume volume-31d415fd-36e0-46e8-8c65-f058265af151 (31d415fd-36e0-46e8-8c65-f058265af151): created successfully Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f919f28-8843-4701-9def-ceb13337a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Flow 'volume_create_manager' (1a75bb46-8273-4501-be22-c6ac67c5ef39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:09:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6cf3a117-4a6c-4f33-9646-47c84d9d7da8 tempest-VolumesAdminNegativeTest-222656915 None] Created volume successfully. Jul 09 01:09:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Acquiring lock "cinder-31d415fd-36e0-46e8-8c65-f058265af151-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:09:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "cinder-31d415fd-36e0-46e8-8c65-f058265af151-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:09:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Acquiring lock "cinder-quobyte-31d415fd-36e0-46e8-8c65-f058265af151" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:09:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "cinder-quobyte-31d415fd-36e0-46e8-8c65-f058265af151" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:09:27 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphembmk83/privsep.sock'] Jul 09 01:09:27 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphembmk83/privsep.sock Jul 09 01:09:28 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 01:09:29 devstack cinder-volume[86954]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 01:09:30 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:30 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Spawned new privsep daemon via rootwrap Jul 09 01:09:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Accepted privsep connection to /tmp/tmphembmk83/privsep.sock {{(pid=86954) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 01:09:30 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 01:09:30 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 01:09:30 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 01:09:30 devstack cinder-volume[86954]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88369 Jul 09 01:09:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38c85d2-eea3-4075-a5d7-ee8a3f6ce182]: (2,) {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:09:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c0957-8482-4d84-a714-ae5fbbcbba6a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:09:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:30 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 Jul 09 01:09:30 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:31 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151" returned: 0 in 1.256s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:31 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151 Jul 09 01:09:31 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:33 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31d415fd-36e0-46e8-8c65-f058265af151" returned: 0 in 1.142s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "cinder-quobyte-31d415fd-36e0-46e8-8c65-f058265af151" released by "delete_volume" :: held 5.089s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:09:33 devstack cinder-volume[86954]: WARNING cinder.quota [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:09:33 devstack cinder-volume[86954]: WARNING cinder.quota [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Created reservations ['d0bc6b75-67b4-49ea-9c2b-dcff3590a232', '5cac2bb1-780d-465a-965b-ed92b76dab7f', '5c5f9b2a-bbd2-43fe-9d49-9cf9a75b6df5', '4d7bb004-2bb8-46b9-8bc1-25d0194cd3ba'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:33 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:09:33 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:33 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:09:33 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:35 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.983s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:09:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Deleted volume successfully. Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4b9c0c57-c40f-4ceb-9094-7505911f0387 tempest-VolumesAdminNegativeTest-222656915 None] Lock "cinder-31d415fd-36e0-46e8-8c65-f058265af151-delete_volume" released by "delete_volume" :: held 7.767s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:09:35 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 2.031s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 8 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:09:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:09:37 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:09:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Flow 'volume_create_manager' (dc8f2129-4fe5-4bfe-99cc-73c4b91b194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:09:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368aa14e-2c02-4316-b27e-965f44d85deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368aa14e-2c02-4316-b27e-965f44d85deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-990996090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8451df8-9859-47d6-bf75-193774467a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcd4c8a52faa471da077cfa48ee68939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:09:38Z,use_quota=True,user_id='ce4eff00417b4fcea6b7c7c3234c52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8215e3-a102-4b13-a884-0feb8031c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8215e3-a102-4b13-a884-0feb8031c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4c69e5-a8ea-4d30-bb99-a1b567c6d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4c69e5-a8ea-4d30-bb99-a1b567c6d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8451df8-9859-47d6-bf75-193774467a63', 'volume_name': 'volume-c8451df8-9859-47d6-bf75-193774467a63', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c761c5f-1666-460b-a6ad-154c39267a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c761c5f-1666-460b-a6ad-154c39267a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba1bea9-6e7f-4ca5-8750-94f3e7164a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Volume c8451df8-9859-47d6-bf75-193774467a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8451df8-9859-47d6-bf75-193774467a63', 'volume_size': 1} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-990996090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8451df8-9859-47d6-bf75-193774467a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcd4c8a52faa471da077cfa48ee68939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:09:38Z,use_quota=True,user_id='ce4eff00417b4fcea6b7c7c3234c52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Creating volume c8451df8-9859-47d6-bf75-193774467a63 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:09:38 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:09:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:38 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 1073741824 Jul 09 01:09:38 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:39 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 1073741824" returned: 0 in 1.369s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:39 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 Jul 09 01:09:39 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:40 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63" returned: 0 in 1.154s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba1bea9-6e7f-4ca5-8750-94f3e7164a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8451df8-9859-47d6-bf75-193774467a63', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092680d-2194-46bd-8a74-63e3c54a701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:09:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Volume volume-c8451df8-9859-47d6-bf75-193774467a63 (c8451df8-9859-47d6-bf75-193774467a63): created successfully Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092680d-2194-46bd-8a74-63e3c54a701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:09:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Flow 'volume_create_manager' (dc8f2129-4fe5-4bfe-99cc-73c4b91b194a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:09:40 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a52149b3-3fa1-4301-81d1-db78efddef65 tempest-DeleteServersTestJSON-1037052395 None] Created volume successfully. Jul 09 01:09:48 devstack cinder-volume[86954]: WARNING py.warnings [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 09 01:09:48 devstack cinder-volume[86954]: .first() Jul 09 01:09:48 devstack cinder-volume[86954]: Jul 09 01:09:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:09:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:09:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d2b12-62f2-489c-ace1-4b7de12601ec]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:09:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:09:48 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 Jul 09 01:09:48 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:09:49 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Jul 09 01:09:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63" returned: 0 in 1.077s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:09:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:09:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-c8451df8-9859-47d6-bf75-193774467a63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acd3980a-1b43-4b4d-a962-92f36b585138', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:09:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-a260f1a8-bb8d-4716-8bb0-9011e1a320fa req-a1b6f315-ed4e-4f36-9fda-cf934d3d4ce6 tempest-DeleteServersTestJSON-1037052395 None] attachment_update completed successfully. Jul 09 01:09:59 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:09:59 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=18,cinder:SELECT=16,cinder:INSERT=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:10:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-3f3fe5cc-f6ba-4c5d-8ff3-4d811bdd38d7 req-289381c5-0bf6-417c-9ea1-2e605b602b38 tempest-DeleteServersTestJSON-1037052395 None] Terminate volume connection completed successfully. Jul 09 01:10:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-3f3fe5cc-f6ba-4c5d-8ff3-4d811bdd38d7 req-289381c5-0bf6-417c-9ea1-2e605b602b38 tempest-DeleteServersTestJSON-1037052395 None] Deleting attachment acd3980a-1b43-4b4d-a962-92f36b585138. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "cinder-c8451df8-9859-47d6-bf75-193774467a63-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "cinder-c8451df8-9859-47d6-bf75-193774467a63-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "cinder-quobyte-c8451df8-9859-47d6-bf75-193774467a63" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "cinder-quobyte-c8451df8-9859-47d6-bf75-193774467a63" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ad106-7c7d-4490-bb2d-c0a3fc0fc82b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:04 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 Jul 09 01:10:04 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:05 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:05 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63 Jul 09 01:10:05 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:06 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c8451df8-9859-47d6-bf75-193774467a63" returned: 0 in 0.761s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "cinder-quobyte-c8451df8-9859-47d6-bf75-193774467a63" released by "delete_volume" :: held 1.682s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Created reservations ['f899ef89-810b-41cb-b7e5-b6b51e0e46fe', 'd27e885a-1656-46fe-9dbb-9413c5f19dda', 'f4985007-69b8-497f-9f77-f4ed6ebf3f29', '3bd53217-297f-434f-9218-189ba5b2663b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:06 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:06 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:07 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.851s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:07 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Deleted volume successfully. Jul 09 01:10:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45ba7db3-0d13-45cf-b747-bef8e6cb6eb1 tempest-DeleteServersTestJSON-1037052395 None] Lock "cinder-c8451df8-9859-47d6-bf75-193774467a63-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Flow 'volume_create_manager' (37d00192-6677-479d-b55a-882f017faec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609bed7c-8df1-4515-8aec-38c5d6e5720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609bed7c-8df1-4515-8aec-38c5d6e5720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-647635682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55c2cce-f043-4775-a20e-adf182a9706c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3b7eca5313c47f4857f644bf1fdc4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:15Z,use_quota=True,user_id='1a5cb3709f75421898ed9af37313bdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5a2945-9a55-4536-9587-7ce02cbe7468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5a2945-9a55-4536-9587-7ce02cbe7468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6e742d-59f4-41e2-bd91-da919d69a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6e742d-59f4-41e2-bd91-da919d69a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55c2cce-f043-4775-a20e-adf182a9706c', 'volume_name': 'volume-b55c2cce-f043-4775-a20e-adf182a9706c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd4fb11-7962-494c-9188-17e601334d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd4fb11-7962-494c-9188-17e601334d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f9bdd4-a38a-41d9-9f11-87513ba84252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Volume b55c2cce-f043-4775-a20e-adf182a9706c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55c2cce-f043-4775-a20e-adf182a9706c', 'volume_size': 1} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-647635682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55c2cce-f043-4775-a20e-adf182a9706c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3b7eca5313c47f4857f644bf1fdc4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:15Z,use_quota=True,user_id='1a5cb3709f75421898ed9af37313bdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Creating volume b55c2cce-f043-4775-a20e-adf182a9706c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:10:15 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:10:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:15 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c 1073741824 Jul 09 01:10:15 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:15 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c 1073741824" returned: 0 in 0.996s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:16 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c Jul 09 01:10:16 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:16 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c" returned: 0 in 0.754s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f9bdd4-a38a-41d9-9f11-87513ba84252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55c2cce-f043-4775-a20e-adf182a9706c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e067d-0345-43b7-bafa-5149e29eafa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:16 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Volume volume-b55c2cce-f043-4775-a20e-adf182a9706c (b55c2cce-f043-4775-a20e-adf182a9706c): created successfully Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e067d-0345-43b7-bafa-5149e29eafa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Flow 'volume_create_manager' (37d00192-6677-479d-b55a-882f017faec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-5173f59f-e159-4ab8-871f-4fb75ce0f92a req-e8beabd6-c206-4029-a9bf-f1b45d54feca tempest-VolumesGetTestJSON-1120564329 None] Created volume successfully. Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Acquiring lock "cinder-b55c2cce-f043-4775-a20e-adf182a9706c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "cinder-b55c2cce-f043-4775-a20e-adf182a9706c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Acquiring lock "cinder-quobyte-b55c2cce-f043-4775-a20e-adf182a9706c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "cinder-quobyte-b55c2cce-f043-4775-a20e-adf182a9706c" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320206c-0e83-4f12-8de6-81719ad175e7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:17 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c Jul 09 01:10:17 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:18 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c" returned: 0 in 0.939s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:18 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c Jul 09 01:10:18 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:19 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b55c2cce-f043-4775-a20e-adf182a9706c" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "cinder-quobyte-b55c2cce-f043-4775-a20e-adf182a9706c" released by "delete_volume" :: held 1.750s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG cinder.quota [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Created reservations ['823f305a-a86e-4f4f-8501-3dea31ba27b2', 'bbe67b03-e416-4568-ae1e-6d7b7b2dbf08', 'cf10aceb-f328-4a70-9d50-88966ba2a1e7', '23ea6c27-bd97-4daf-8b71-5bc8435ed700'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:19 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:19 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:20 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.868s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:20 devstack cinder-volume[86954]: DEBUG cinder.manager [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Deleted volume successfully. Jul 09 01:10:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-0d03d8c8-c7e8-489c-a92a-6aa7fa02031a req-53a8aabe-da6a-4662-a126-51081cc08ee6 tempest-VolumesGetTestJSON-1120564329 None] Lock "cinder-b55c2cce-f043-4775-a20e-adf182a9706c-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Flow 'volume_create_manager' (9411e206-7766-4abe-bab8-b58840ff0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d201c2-7769-430b-8807-59c595b9e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d201c2-7769-430b-8807-59c595b9e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890293467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60260b7e-6ce6-4845-a0b5-c7fb09911900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f95bdb83784fdfb4ce01fdc8fb1dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:24Z,use_quota=True,user_id='d3d030322f8041cab538c41c13d46cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4a96d-2be1-40b9-9ecc-777535a4207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4a96d-2be1-40b9-9ecc-777535a4207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336100bb-2dc2-4b93-b739-22859640250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336100bb-2dc2-4b93-b739-22859640250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60260b7e-6ce6-4845-a0b5-c7fb09911900', 'volume_name': 'volume-60260b7e-6ce6-4845-a0b5-c7fb09911900', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddff696-541a-4207-a48f-cc33a1e36f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddff696-541a-4207-a48f-cc33a1e36f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d14a1d-1e7f-424f-8eb5-734e0ee6bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Volume 60260b7e-6ce6-4845-a0b5-c7fb09911900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60260b7e-6ce6-4845-a0b5-c7fb09911900', 'volume_size': 1} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890293467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60260b7e-6ce6-4845-a0b5-c7fb09911900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f95bdb83784fdfb4ce01fdc8fb1dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:24Z,use_quota=True,user_id='d3d030322f8041cab538c41c13d46cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Creating volume 60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:10:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:10:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:23 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 1073741824 Jul 09 01:10:23 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-764d5ab2-817c-4909-8458-727afb6a3da9 tempest-GroupsTest-1169866156 None] Group tempest-Group1-1410485088: creating Jul 09 01:10:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-764d5ab2-817c-4909-8458-727afb6a3da9 tempest-GroupsTest-1169866156 None] Group tempest-Group1-1410485088: created successfully Jul 09 01:10:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-764d5ab2-817c-4909-8458-727afb6a3da9 tempest-GroupsTest-1169866156 None] Create group completed successfully. Jul 09 01:10:24 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 1073741824" returned: 0 in 0.979s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:24 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 Jul 09 01:10:24 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:25 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900" returned: 0 in 0.775s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d14a1d-1e7f-424f-8eb5-734e0ee6bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60260b7e-6ce6-4845-a0b5-c7fb09911900', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7bf6a-fac7-4958-acea-a8dd1fef3ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Volume volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 (60260b7e-6ce6-4845-a0b5-c7fb09911900): created successfully Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7bf6a-fac7-4958-acea-a8dd1fef3ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Flow 'volume_create_manager' (9411e206-7766-4abe-bab8-b58840ff0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7d81f2a4-a6d6-45e7-ba4a-e0401492f7cc tempest-ServerActionsTestOtherA-1159923806 None] Created volume successfully. Jul 09 01:10:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-74d31aa6-6213-4743-9760-91bad24a4cb6 tempest-GroupsTest-1169866156 None] Group tempest-Group2-44908625: creating Jul 09 01:10:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-74d31aa6-6213-4743-9760-91bad24a4cb6 tempest-GroupsTest-1169866156 None] Group tempest-Group2-44908625: created successfully Jul 09 01:10:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-74d31aa6-6213-4743-9760-91bad24a4cb6 tempest-GroupsTest-1169866156 None] Create group completed successfully. Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (6d4e972e-845a-44db-bcf5-b80023f39912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b4db81-629c-471c-8711-8ab4d8fd0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b4db81-629c-471c-8711-8ab4d8fd0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319871400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f97e5c8-9191-46b7-bb69-db8e69149d9c,host='devstack@QuobyteHD#QuobyteHD',id=48dfd514-9fc3-4e94-bb33-eac3adbdb28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:28Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c7d2aed-c4c9-4f44-ad39-0c380ddc4e0b),volume_type_id=2c7d2aed-c4c9-4f44-ad39-0c380ddc4e0b)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fd0fd-deca-42f5-9599-613d6794376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fd0fd-deca-42f5-9599-613d6794376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3171a1-050e-46ab-b252-5696dd0762f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3171a1-050e-46ab-b252-5696dd0762f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dfd514-9fc3-4e94-bb33-eac3adbdb28e', 'volume_name': 'volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c40a93-ca68-41ba-85bb-78ee9135c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c40a93-ca68-41ba-85bb-78ee9135c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f63f61-619d-4f21-89a7-93e60f47a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Volume 48dfd514-9fc3-4e94-bb33-eac3adbdb28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e', 'volume_size': 1} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f97e5c8-9191-46b7-bb69-db8e69149d9c,created_at=2026-07-08T23:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319871400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f97e5c8-9191-46b7-bb69-db8e69149d9c,host='devstack@QuobyteHD#QuobyteHD',id=48dfd514-9fc3-4e94-bb33-eac3adbdb28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:28Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c7d2aed-c4c9-4f44-ad39-0c380ddc4e0b),volume_type_id=2c7d2aed-c4c9-4f44-ad39-0c380ddc4e0b)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Creating volume 48dfd514-9fc3-4e94-bb33-eac3adbdb28e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:10:27 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:10:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:28 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e 1073741824 Jul 09 01:10:28 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:28 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e 1073741824" returned: 0 in 0.897s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:28 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e Jul 09 01:10:28 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:29 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" returned: 0 in 0.673s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.065s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f63f61-619d-4f21-89a7-93e60f47a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031a378e-e6ac-490f-aebc-12ec0775e896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b36e05-c30f-42fd-86af-11e02d02d3ed]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:29 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Volume volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e (48dfd514-9fc3-4e94-bb33-eac3adbdb28e): created successfully Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031a378e-e6ac-490f-aebc-12ec0775e896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (6d4e972e-845a-44db-bcf5-b80023f39912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-12cf7849-8ecb-40ff-8b87-69059c97d2c7 tempest-GroupsTest-1169866156 None] Created volume successfully. Jul 09 01:10:29 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f Jul 09 01:10:29 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:30 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f" returned: 0 in 0.873s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-94f07350-57ee-4ef1-a85e-8488c2afce8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9137a58-8e7e-4262-a87f-a271f0925067', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:10:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-5dcd197c-06a6-43d1-950d-90fbf3bcb882 req-92b9f04c-7871-40f8-afab-c8801290dcb8 tempest-TaggedAttachmentsTest-1286207677 None] attachment_update completed successfully. Jul 09 01:10:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Acquiring lock "cinder-quobyte-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3f053-dfcf-4635-8ff8-46ab01567371]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:31 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e Jul 09 01:10:31 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:32 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" returned: 0 in 0.998s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:32 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e Jul 09 01:10:32 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:33 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" returned: 0 in 1.169s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-48dfd514-9fc3-4e94-bb33-eac3adbdb28e" released by "delete_volume" :: held 2.277s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Created reservations ['b2d21bac-ccc8-457a-b854-2777925e3fc1'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:33 devstack cinder-volume[86954]: WARNING cinder.quota [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-908908387 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-908908387, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:10:33 devstack cinder-volume[86954]: WARNING cinder.quota [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-908908387 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-908908387, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Created reservations ['d43a0012-1005-4b05-b216-3353cab22042', 'd9510f88-7a38-499f-a25a-260e68f10cb6', '83c13c36-4c21-4835-87bb-7a90846b5800', '8dcaff21-1331-489e-b963-13a8f6fba3da'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:33 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:33 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:34 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:34 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:35 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.312s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:35 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.432s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2a3d8a56-f78a-41f1-a6de-3d6503dba8df tempest-GroupsTest-1169866156 None] Delete group completed successfully. Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Created reservations ['ef3988a8-12d3-49b6-9a51-bde412dab1ea'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:35 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:35 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:36 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.896s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:36 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3280fc55-a7a1-46da-9e4b-0d3333b5832a tempest-GroupsTest-1169866156 None] Delete group completed successfully. Jul 09 01:10:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a519957e-93a7-45b9-b737-66ff43aed665 tempest-GroupsTest-1169866156 None] Group tempest-GroupsTest-Group-212818401: creating Jul 09 01:10:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a519957e-93a7-45b9-b737-66ff43aed665 tempest-GroupsTest-1169866156 None] Group tempest-GroupsTest-Group-212818401: created successfully Jul 09 01:10:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a519957e-93a7-45b9-b737-66ff43aed665 tempest-GroupsTest-1169866156 None] Create group completed successfully. Jul 09 01:10:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-42460a90-9f67-4457-a6af-ab4bbddf4a34 req-cf2c1114-eb55-4429-838e-07ceceffcf08 tempest-TaggedAttachmentsTest-1286207677 None] Terminate volume connection completed successfully. Jul 09 01:10:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-42460a90-9f67-4457-a6af-ab4bbddf4a34 req-cf2c1114-eb55-4429-838e-07ceceffcf08 tempest-TaggedAttachmentsTest-1286207677 None] Deleting attachment d9137a58-8e7e-4262-a87f-a271f0925067. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (1b6fcb78-c81e-4ed4-987c-d27a365e1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a59c25d-f822-496b-bc07-8376dd163464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a59c25d-f822-496b-bc07-8376dd163464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009050943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,host='devstack@QuobyteHD#QuobyteHD',id=a20f7bfc-f6de-4bce-8796-feb93b5c1742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:39Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3365a-b475-4e90-967a-3fe3934bce08),volume_type_id=8fd3365a-b475-4e90-967a-3fe3934bce08)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a63b20b-6de1-4e37-93d3-8c19973f6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a63b20b-6de1-4e37-93d3-8c19973f6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7f890b-5335-4f54-a3e5-29fc6bf87909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7f890b-5335-4f54-a3e5-29fc6bf87909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20f7bfc-f6de-4bce-8796-feb93b5c1742', 'volume_name': 'volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83baa750-2bec-4ac1-9480-bcd807d2c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83baa750-2bec-4ac1-9480-bcd807d2c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb86b5-e1fc-46c0-8ada-143ab3188aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Volume a20f7bfc-f6de-4bce-8796-feb93b5c1742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742', 'volume_size': 1} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,created_at=2026-07-08T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009050943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,host='devstack@QuobyteHD#QuobyteHD',id=a20f7bfc-f6de-4bce-8796-feb93b5c1742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:39Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3365a-b475-4e90-967a-3fe3934bce08),volume_type_id=8fd3365a-b475-4e90-967a-3fe3934bce08)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Creating volume a20f7bfc-f6de-4bce-8796-feb93b5c1742 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:10:39 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:10:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:39 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 1073741824 Jul 09 01:10:39 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:41 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 1073741824" returned: 0 in 1.354s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:41 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 Jul 09 01:10:41 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:42 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb86b5-e1fc-46c0-8ada-143ab3188aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6c08a-d728-4dce-932d-8cfb29852b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Volume volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 (a20f7bfc-f6de-4bce-8796-feb93b5c1742): created successfully Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6c08a-d728-4dce-932d-8cfb29852b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (1b6fcb78-c81e-4ed4-987c-d27a365e1e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ced9b95f-cf69-4afc-b54b-d023409c6ed3 tempest-GroupsTest-1169866156 None] Created volume successfully. Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (658ba997-b353-4c7a-86b8-2d2524f7bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f229656b-7cd4-4bb9-aa1f-014baa170153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f229656b-7cd4-4bb9-aa1f-014baa170153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150200213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,host='devstack@QuobyteHD#QuobyteHD',id=d90bf854-b269-42da-a134-02b15fe9d5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:45Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3365a-b475-4e90-967a-3fe3934bce08),volume_type_id=8fd3365a-b475-4e90-967a-3fe3934bce08)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e6f6e9-d609-49e3-a047-cbc8fe5e5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e6f6e9-d609-49e3-a047-cbc8fe5e5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a63a77-2142-4966-9f7b-2db10685ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a63a77-2142-4966-9f7b-2db10685ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90bf854-b269-42da-a134-02b15fe9d5b8', 'volume_name': 'volume-d90bf854-b269-42da-a134-02b15fe9d5b8', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b6f72b-1532-47d3-be2b-76eb48185d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b6f72b-1532-47d3-be2b-76eb48185d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5492bd5e-0db4-4e57-a3dd-e4d3e94b64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Volume d90bf854-b269-42da-a134-02b15fe9d5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90bf854-b269-42da-a134-02b15fe9d5b8', 'volume_size': 1} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,created_at=2026-07-08T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150200213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cd5b959-5c64-4dae-9789-bb664122e9e2,host='devstack@QuobyteHD#QuobyteHD',id=d90bf854-b269-42da-a134-02b15fe9d5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1939a6e5d245f9ad3e48d8ad6736fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:10:45Z,use_quota=True,user_id='1a78b591caaf44f3bd34ec8dd0893327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3365a-b475-4e90-967a-3fe3934bce08),volume_type_id=8fd3365a-b475-4e90-967a-3fe3934bce08)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Creating volume d90bf854-b269-42da-a134-02b15fe9d5b8 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:10:44 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:10:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:45 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 1073741824 Jul 09 01:10:45 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:46 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 1073741824" returned: 0 in 1.306s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:46 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 Jul 09 01:10:46 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:47 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5492bd5e-0db4-4e57-a3dd-e4d3e94b64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90bf854-b269-42da-a134-02b15fe9d5b8', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7a2826-3375-4f1a-8799-53ebaef1bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:10:47 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Volume volume-d90bf854-b269-42da-a134-02b15fe9d5b8 (d90bf854-b269-42da-a134-02b15fe9d5b8): created successfully Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7a2826-3375-4f1a-8799-53ebaef1bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:10:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Flow 'volume_create_manager' (658ba997-b353-4c7a-86b8-2d2524f7bf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:10:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5d68f907-b570-48ab-b3aa-8e94e3881826 tempest-GroupsTest-1169866156 None] Created volume successfully. Jul 09 01:10:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f945fd6f-114d-4948-aaa9-fc8fee9343e5 tempest-GroupsTest-1169866156 None] Update group completed successfully. Jul 09 01:10:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ae02f1db-8e59-4d3f-a11e-9dc51ed2831b tempest-GroupsTest-1169866156 None] Update group completed successfully. Jul 09 01:10:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Acquiring lock "cinder-quobyte-a20f7bfc-f6de-4bce-8796-feb93b5c1742" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-a20f7bfc-f6de-4bce-8796-feb93b5c1742" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fef1d8-e353-4a15-8807-a01faaf45bf8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:51 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 Jul 09 01:10:51 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:52 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:52 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742 Jul 09 01:10:52 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:53 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a20f7bfc-f6de-4bce-8796-feb93b5c1742" returned: 0 in 0.800s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-a20f7bfc-f6de-4bce-8796-feb93b5c1742" released by "delete_volume" :: held 1.910s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Acquiring lock "cinder-quobyte-d90bf854-b269-42da-a134-02b15fe9d5b8" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-d90bf854-b269-42da-a134-02b15fe9d5b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fb8c7-5473-4be6-bad5-b9663169b0c9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:10:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:53 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 Jul 09 01:10:53 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:54 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:54 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8 Jul 09 01:10:54 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:55 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d90bf854-b269-42da-a134-02b15fe9d5b8" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "cinder-quobyte-d90bf854-b269-42da-a134-02b15fe9d5b8" released by "delete_volume" :: held 1.564s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Created reservations ['b76c6a74-ba90-4095-b8db-2e9154bacbe1'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:55 devstack cinder-volume[86954]: WARNING cinder.quota [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-551612319 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-551612319, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:10:55 devstack cinder-volume[86954]: WARNING cinder.quota [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-551612319 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-551612319, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Created reservations ['fb71bb6c-f5f6-4ff2-8cd5-9bcdcafe1a05', 'eece71ec-e9a1-48f6-826c-68f5b82f4007', 'f5ad7698-e28d-4b01-9602-c4e3d0b5f5c2', 'ab642c13-e960-46af-b085-7ccbc53c21dd'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Created reservations ['dad4b2bf-eb9f-489d-a0b9-a1b6f5bdebbe', 'f7115ed5-a57e-4079-9df3-32b0d648f74e', '61d02e49-8ae6-4b50-a263-2b0830ab4a99', '474edc6b-9f2a-4fc1-9c1d-eebe286155a2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:10:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:10:55 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:10:55 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:10:56 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Jul 09 01:10:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:10:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:10:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-45dd9c07-025b-4b4d-8480-206ec3e00619 tempest-GroupsTest-1169866156 None] Delete group completed successfully. Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "cinder-94f07350-57ee-4ef1-a85e-8488c2afce8f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "cinder-94f07350-57ee-4ef1-a85e-8488c2afce8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=63,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=64,cinder:UPDATE=71,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "cinder-quobyte-94f07350-57ee-4ef1-a85e-8488c2afce8f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "cinder-quobyte-94f07350-57ee-4ef1-a85e-8488c2afce8f" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d5486-6111-4805-a978-7ba064a455f5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:11:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:00 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f Jul 09 01:11:00 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:01 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f" returned: 0 in 0.862s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:01 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f Jul 09 01:11:01 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (1e8333f6-cdee-4793-bf98-5e4c623bb827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca86c67-593e-4363-a82c-0fbdae05e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca86c67-593e-4363-a82c-0fbdae05e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1907165996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeff733e-96a4-4f6d-9f8c-e888dcda09eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:11:01Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b43914c-8ea5-4e28-a609-9d1c47f72d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b43914c-8ea5-4e28-a609-9d1c47f72d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a36cec-3125-47b0-a0d0-2395fb32f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a36cec-3125-47b0-a0d0-2395fb32f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeff733e-96a4-4f6d-9f8c-e888dcda09eb', 'volume_name': 'volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee94d3-1f43-4ac4-a9d5-9d8d6cb3a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee94d3-1f43-4ac4-a9d5-9d8d6cb3a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e723d5-c770-4023-b02e-3a044207e271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:01 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Volume eeff733e-96a4-4f6d-9f8c-e888dcda09eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb', 'volume_size': 1} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1907165996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeff733e-96a4-4f6d-9f8c-e888dcda09eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:11:01Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Creating volume eeff733e-96a4-4f6d-9f8c-e888dcda09eb {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:11:01 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:01 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb 1073741824 Jul 09 01:11:01 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:01 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-94f07350-57ee-4ef1-a85e-8488c2afce8f" returned: 0 in 0.674s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "cinder-quobyte-94f07350-57ee-4ef1-a85e-8488c2afce8f" released by "delete_volume" :: held 1.579s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Created reservations ['ffdd1f91-9385-407b-925c-919d60cb0a8d', 'e1ad4863-18f1-453b-9f26-69025bd2d114', 'ec3de141-faaa-49ea-94bf-d41b7e68e171', '974ccc41-86cd-408b-865d-f1d9331e6260'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:01 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:11:01 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:02 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb 1073741824" returned: 0 in 0.929s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:02 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb Jul 09 01:11:02 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:02 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:11:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Deleted volume successfully. Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bceeef93-16e7-4e3a-b5e0-7cf58e5d5bbe tempest-TaggedAttachmentsTest-1286207677 None] Lock "cinder-94f07350-57ee-4ef1-a85e-8488c2afce8f-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:11:02 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e723d5-c770-4023-b02e-3a044207e271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3306f24-2bc2-4bd6-b433-aa9beb6f0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:11:02 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Volume volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb (eeff733e-96a4-4f6d-9f8c-e888dcda09eb): created successfully Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3306f24-2bc2-4bd6-b433-aa9beb6f0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:11:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (1e8333f6-cdee-4793-bf98-5e4c623bb827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:11:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fac62572-5334-483c-b1ef-faac46b92c34 tempest-AttachVolumeNegativeTest-1699498806 None] Created volume successfully. Jul 09 01:11:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284459b-eafa-459c-8224-88b1d7f27c19]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:11:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:06 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb Jul 09 01:11:06 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:07 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" returned: 0 in 0.970s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f96fced4-dbc1-4bf9-a6ca-0d7bac5e9f68', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:11:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-009c7de8-91b4-4d26-a363-df0506d91845 req-76072d29-190e-4390-9844-c1a5523f9071 tempest-AttachVolumeNegativeTest-1699498806 None] attachment_update completed successfully. Jul 09 01:11:17 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:11:17 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:11:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fed5ac-c97c-4679-a44e-371b47376e59]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:11:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:26 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 Jul 09 01:11:26 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:27 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900" returned: 0 in 0.911s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-60260b7e-6ce6-4845-a0b5-c7fb09911900', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a910f8ec-51b5-4c19-859f-a07d8f087f35', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:11:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-30e05f76-c263-475a-a29e-e509acbebacc req-04da924d-116f-4cbb-b8ba-5cd3709039ee tempest-ServerActionsTestOtherA-1159923806 None] attachment_update completed successfully. Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:33 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:11:33 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:34 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.141s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:11:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:11:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 8 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:11:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:11:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-261865c0-e012-4e8e-b2db-f64ba0ca0a8f tempest-ServerActionsTestOtherA-1159923806 None] Terminate volume connection completed successfully. Jul 09 01:11:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-261865c0-e012-4e8e-b2db-f64ba0ca0a8f tempest-ServerActionsTestOtherA-1159923806 None] Deleting attachment a910f8ec-51b5-4c19-859f-a07d8f087f35. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:11:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:11:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:11:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1767b4f-3356-4bb4-a620-30581e3e8a1d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:11:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:11:40 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 Jul 09 01:11:40 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:11:41 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 09 01:11:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900" returned: 0 in 1.449s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:11:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.479s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:11:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-60260b7e-6ce6-4845-a0b5-c7fb09911900', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72d1a369-2bd3-464a-a7ea-393e39934f94', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:11:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-caa52546-c1ad-42b3-9e8b-a13b7c97eaf2 req-60e9766e-8fe0-4523-96fb-aa0ea60835f0 tempest-ServerActionsTestOtherA-1159923806 None] attachment_update completed successfully. Jul 09 01:11:51 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:11:51 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (4cdf60ca-d3c4-4dad-9a76-679cb69b78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda6a26-5e76-4f94-9faf-e31f1f240c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda6a26-5e76-4f94-9faf-e31f1f240c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163628714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade7497-ea75-42b1-ac47-3a09136ed9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:11Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8695277a-fe04-42d9-999e-5c69147a8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8695277a-fe04-42d9-999e-5c69147a8007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c495116-1791-4681-bea1-73d9960161da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c495116-1791-4681-bea1-73d9960161da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ade7497-ea75-42b1-ac47-3a09136ed9a2', 'volume_name': 'volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b4f1e3-c514-4318-9565-d536b8d9ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b4f1e3-c514-4318-9565-d536b8d9ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de23d7e-5acf-4272-b1b8-4474f3fb8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Volume 4ade7497-ea75-42b1-ac47-3a09136ed9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2', 'volume_size': 1} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163628714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade7497-ea75-42b1-ac47-3a09136ed9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:11Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Creating volume 4ade7497-ea75-42b1-ac47-3a09136ed9a2 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:11 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:11 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 1073741824 Jul 09 01:12:11 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:11 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-959c0baa-4680-40c9-8926-7d0b0578b69d req-b2311b3f-29f9-41da-b39d-fec5fc3ce9f7 tempest-AttachVolumeNegativeTest-1699498806 None] Terminate volume connection completed successfully. Jul 09 01:12:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-959c0baa-4680-40c9-8926-7d0b0578b69d req-b2311b3f-29f9-41da-b39d-fec5fc3ce9f7 tempest-AttachVolumeNegativeTest-1699498806 None] Deleting attachment f96fced4-dbc1-4bf9-a6ca-0d7bac5e9f68. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:12:12 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 1073741824" returned: 0 in 1.253s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:12 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 Jul 09 01:12:12 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:13 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2" returned: 0 in 0.695s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de23d7e-5acf-4272-b1b8-4474f3fb8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e211ddb-67aa-49d0-861b-cc0479c53d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Volume volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 (4ade7497-ea75-42b1-ac47-3a09136ed9a2): created successfully Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e211ddb-67aa-49d0-861b-cc0479c53d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (4cdf60ca-d3c4-4dad-9a76-679cb69b78fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f1ff7f52-d165-4fac-96ea-3d1232101554 tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:12:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-47a2b3cf-2c5b-4942-8898-aea95027972e tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2" by "attach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-47a2b3cf-2c5b-4942-8898-aea95027972e tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2" acquired by "attach_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-47a2b3cf-2c5b-4942-8898-aea95027972e tempest-VolumesActionsTest-1704887736 None] Attaching volume 4ade7497-ea75-42b1-ac47-3a09136ed9a2 to instance 9c0555b6-e4ea-4455-abf0-7ab1643f5ba3 at mountpoint /dev/vdb on host None. Jul 09 01:12:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-47a2b3cf-2c5b-4942-8898-aea95027972e tempest-VolumesActionsTest-1704887736 None] Attach volume completed successfully. Jul 09 01:12:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-47a2b3cf-2c5b-4942-8898-aea95027972e tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2" released by "attach_volume" :: held 0.159s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Terminate volume connection completed successfully. Jul 09 01:12:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" by "detach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Detaching volume 4ade7497-ea75-42b1-ac47-3a09136ed9a2 from instance 9c0555b6-e4ea-4455-abf0-7ab1643f5ba3. Jul 09 01:12:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Detach volume completed successfully. Jul 09 01:12:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b4202bef-22b4-438e-b8c5-75ce211fe49c tempest-VolumesActionsTest-1366265795 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a66db61f-3e0d-4c83-8167-5ccdd9eb416d tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" by "detach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a66db61f-3e0d-4c83-8167-5ccdd9eb416d tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a66db61f-3e0d-4c83-8167-5ccdd9eb416d tempest-VolumesActionsTest-1704887736 None] Volume detach called, but volume not attached. Jul 09 01:12:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a66db61f-3e0d-4c83-8167-5ccdd9eb416d tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-quobyte-4ade7497-ea75-42b1-ac47-3a09136ed9a2" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "cinder-quobyte-4ade7497-ea75-42b1-ac47-3a09136ed9a2" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2a3e9-734d-4fc3-867f-4d2877593eb5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:18 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 Jul 09 01:12:18 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Flow 'volume_create_manager' (b4f77ae3-36a3-4760-b4c6-7c3eb297d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae1452f-c4cb-4bf3-a6db-8d8eefe40e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae1452f-c4cb-4bf3-a6db-8d8eefe40e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-80089893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578cd296-071c-4fcd-bb76-c9ca5de111c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58786adea60b48c5b5906650aabdf3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:18Z,use_quota=True,user_id='e3cdd9218ebf4848adb15d537a1d1eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da01e16c-e2c9-49cf-a71e-204aba977dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da01e16c-e2c9-49cf-a71e-204aba977dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256de34b-67b6-4d43-89a9-9f46b007250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256de34b-67b6-4d43-89a9-9f46b007250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578cd296-071c-4fcd-bb76-c9ca5de111c0', 'volume_name': 'volume-578cd296-071c-4fcd-bb76-c9ca5de111c0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c7bb6-a9fd-4a66-9db4-bab61584c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078c7bb6-a9fd-4a66-9db4-bab61584c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cbfa80-364a-488d-be4d-30844523a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:18 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Volume 578cd296-071c-4fcd-bb76-c9ca5de111c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578cd296-071c-4fcd-bb76-c9ca5de111c0', 'volume_size': 1} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-80089893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578cd296-071c-4fcd-bb76-c9ca5de111c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58786adea60b48c5b5906650aabdf3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:18Z,use_quota=True,user_id='e3cdd9218ebf4848adb15d537a1d1eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Creating volume 578cd296-071c-4fcd-bb76-c9ca5de111c0 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:18 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:18 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 1073741824 Jul 09 01:12:18 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:19 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2" returned: 0 in 1.096s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:19 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2 Jul 09 01:12:19 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:19 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 1073741824" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:19 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 Jul 09 01:12:19 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:19 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4ade7497-ea75-42b1-ac47-3a09136ed9a2" returned: 0 in 0.787s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "cinder-quobyte-4ade7497-ea75-42b1-ac47-3a09136ed9a2" released by "delete_volume" :: held 1.979s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:19 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Created reservations ['da06345b-9f7c-4151-8cbd-8afefb985bd2', 'eb956cd6-78e3-4d08-b0c1-d52538c14de2', '84975878-d29d-4893-b7ba-5d0eca7432f1', '7954be9d-8b09-4598-a3d0-eeeaf4563c54'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:20 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:20 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:20 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cbfa80-364a-488d-be4d-30844523a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578cd296-071c-4fcd-bb76-c9ca5de111c0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e88b667-fdf8-4efa-a004-52935e739abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Volume volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 (578cd296-071c-4fcd-bb76-c9ca5de111c0): created successfully Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e88b667-fdf8-4efa-a004-52935e739abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Flow 'volume_create_manager' (b4f77ae3-36a3-4760-b4c6-7c3eb297d02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-50bf4c9b-89d5-44d6-b7a9-8529a0a9ed85 tempest-ServersNegativeTestJSON-1087191432 None] Created volume successfully. Jul 09 01:12:20 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Deleted volume successfully. Jul 09 01:12:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68f27614-9b56-4819-98fc-04803bc47692 tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4ade7497-ea75-42b1-ac47-3a09136ed9a2-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Flow 'volume_create_manager' (b594c050-e940-4857-b979-8b4fb5a906c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6eec25-0fff-4c5d-91ff-24faa1d78f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6eec25-0fff-4c5d-91ff-24faa1d78f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260642170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f9f81-fa27-42a8-b997-039b3426a2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58786adea60b48c5b5906650aabdf3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:23Z,use_quota=True,user_id='e3cdd9218ebf4848adb15d537a1d1eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc00a617-be92-4587-8648-b34d20ff4eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc00a617-be92-4587-8648-b34d20ff4eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a526811-22e9-4f97-adde-9f84f642abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a526811-22e9-4f97-adde-9f84f642abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936f9f81-fa27-42a8-b997-039b3426a2b4', 'volume_name': 'volume-936f9f81-fa27-42a8-b997-039b3426a2b4', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a1eecc-5735-4951-86af-711d5d0a0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a1eecc-5735-4951-86af-711d5d0a0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67df10b1-0c7c-4529-9654-ec62f4f6ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Volume 936f9f81-fa27-42a8-b997-039b3426a2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936f9f81-fa27-42a8-b997-039b3426a2b4', 'volume_size': 1} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260642170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f9f81-fa27-42a8-b997-039b3426a2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58786adea60b48c5b5906650aabdf3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:23Z,use_quota=True,user_id='e3cdd9218ebf4848adb15d537a1d1eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Creating volume 936f9f81-fa27-42a8-b997-039b3426a2b4 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:23 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 1073741824 Jul 09 01:12:23 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:24 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 1073741824" returned: 0 in 1.015s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:24 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 Jul 09 01:12:24 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:24 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67df10b1-0c7c-4529-9654-ec62f4f6ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936f9f81-fa27-42a8-b997-039b3426a2b4', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150ac9c-af78-4948-877d-e02aa71075a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Volume volume-936f9f81-fa27-42a8-b997-039b3426a2b4 (936f9f81-fa27-42a8-b997-039b3426a2b4): created successfully Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150ac9c-af78-4948-877d-e02aa71075a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Flow 'volume_create_manager' (b594c050-e940-4857-b979-8b4fb5a906c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9e7df697-58d5-4d6c-9bd4-bc46e5eb36de tempest-ServersNegativeTestJSON-1087191432 None] Created volume successfully. Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "cinder-936f9f81-fa27-42a8-b997-039b3426a2b4-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-936f9f81-fa27-42a8-b997-039b3426a2b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "cinder-quobyte-936f9f81-fa27-42a8-b997-039b3426a2b4" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-quobyte-936f9f81-fa27-42a8-b997-039b3426a2b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a060ad4-3b24-4699-8e72-2ab63de0d155]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:25 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 Jul 09 01:12:25 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:26 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4" returned: 0 in 0.786s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:26 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4 Jul 09 01:12:26 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:27 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-936f9f81-fa27-42a8-b997-039b3426a2b4" returned: 0 in 0.696s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-quobyte-936f9f81-fa27-42a8-b997-039b3426a2b4" released by "delete_volume" :: held 1.524s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Created reservations ['743554dd-38f2-4145-acb6-1e877d8a0d69', '3f9a1043-8ab8-45b4-aa48-6c161d0d2e0a', 'd3fefd7f-3f02-427e-b39f-ded85853a25e', '59b30e4e-8cd7-4edd-96e9-4268cc0ba88b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:27 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:27 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "cinder-578cd296-071c-4fcd-bb76-c9ca5de111c0-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-578cd296-071c-4fcd-bb76-c9ca5de111c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "cinder-quobyte-578cd296-071c-4fcd-bb76-c9ca5de111c0" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-quobyte-578cd296-071c-4fcd-bb76-c9ca5de111c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be73e1-2ec8-43e4-a73d-626777607582]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:27 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Deleted volume successfully. Jul 09 01:12:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6412f75a-2ca2-4686-b6d2-265d8a367411 tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-936f9f81-fa27-42a8-b997-039b3426a2b4-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:28 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 Jul 09 01:12:28 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (f0c4aece-fe07-40a7-bdeb-06d9adeb92ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae3a174-585e-4e27-80bf-4805b13687f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae3a174-585e-4e27-80bf-4805b13687f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890272564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19354e9a-247c-4c4f-a926-5bcd4b810169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:28Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85864e69-4cfe-4b03-a587-20ec2ab8173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85864e69-4cfe-4b03-a587-20ec2ab8173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfdd72-a67c-4d18-b0af-e9b03ac4ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfdd72-a67c-4d18-b0af-e9b03ac4ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19354e9a-247c-4c4f-a926-5bcd4b810169', 'volume_name': 'volume-19354e9a-247c-4c4f-a926-5bcd4b810169', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c9c497-131a-4b19-b575-be0d6caa6a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c9c497-131a-4b19-b575-be0d6caa6a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24bd8f9-37fc-44b6-9eb4-044c60fc05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:28 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Volume 19354e9a-247c-4c4f-a926-5bcd4b810169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19354e9a-247c-4c4f-a926-5bcd4b810169', 'volume_size': 1} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890272564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19354e9a-247c-4c4f-a926-5bcd4b810169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:28Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Creating volume 19354e9a-247c-4c4f-a926-5bcd4b810169 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:28 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:28 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 1073741824 Jul 09 01:12:28 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:28 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0" returned: 0 in 0.846s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:28 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0 Jul 09 01:12:28 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:29 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 1073741824" returned: 0 in 1.017s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-578cd296-071c-4fcd-bb76-c9ca5de111c0" returned: 0 in 0.729s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:29 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-quobyte-578cd296-071c-4fcd-bb76-c9ca5de111c0" released by "delete_volume" :: held 1.628s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:29 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 Jul 09 01:12:29 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Created reservations ['579ba757-37b5-4517-81a9-cf8dcd484be0', '26cfce39-1fb6-47b5-9f4d-641bb1d28ff2', '5b8d2773-7ad8-474d-aefa-30b0f91d32ad', '98c7a7cf-ad10-462f-b422-b65002f7ac87'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:29 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:29 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:30 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Deleted volume successfully. Jul 09 01:12:30 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169" returned: 0 in 0.962s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24bd8f9-37fc-44b6-9eb4-044c60fc05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19354e9a-247c-4c4f-a926-5bcd4b810169', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7baa479-562f-4f3b-8a29-b92a992d6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8b11901b-08a5-42ad-b355-b37b72832aee tempest-ServersNegativeTestJSON-1087191432 None] Lock "cinder-578cd296-071c-4fcd-bb76-c9ca5de111c0-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Volume volume-19354e9a-247c-4c4f-a926-5bcd4b810169 (19354e9a-247c-4c4f-a926-5bcd4b810169): created successfully Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7baa479-562f-4f3b-8a29-b92a992d6567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (f0c4aece-fe07-40a7-bdeb-06d9adeb92ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-42634907-7e6e-429a-a636-87b96bce5472 tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:12:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-d353e67e-78d2-4020-ba27-f3f809038765 req-47b68298-be23-4f29-890e-66c4cd771980 tempest-ServerActionsTestOtherA-1159923806 None] Terminate volume connection completed successfully. Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-d353e67e-78d2-4020-ba27-f3f809038765 req-47b68298-be23-4f29-890e-66c4cd771980 tempest-ServerActionsTestOtherA-1159923806 None] Deleting attachment 72d1a369-2bd3-464a-a7ea-393e39934f94. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-19354e9a-247c-4c4f-a926-5bcd4b810169-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-19354e9a-247c-4c4f-a926-5bcd4b810169-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-quobyte-19354e9a-247c-4c4f-a926-5bcd4b810169" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-19354e9a-247c-4c4f-a926-5bcd4b810169" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03de482-8355-4ddd-beb5-2fd6ac75c9a5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:32 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 Jul 09 01:12:32 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:33 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169" returned: 0 in 1.223s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:33 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169 Jul 09 01:12:33 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:33 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:33 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:34 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-19354e9a-247c-4c4f-a926-5bcd4b810169" returned: 0 in 1.136s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-19354e9a-247c-4c4f-a926-5bcd4b810169" released by "delete_volume" :: held 2.439s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Created reservations ['557049d3-0ba3-4bfa-b0ae-9ac1fa83b7ca', '4631edc1-edde-4432-9012-2ffb5909f6d6', 'd82583b2-f28a-4897-88eb-8b80607ed65d', 'ed9a0f7c-b85a-4efc-9416-7b69d6654d0e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:34 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:34 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:34 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.912s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 8 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:12:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:12:35 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Deleted volume successfully. Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93db9075-310f-4cb8-9a4a-38e427bdf68b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-19354e9a-247c-4c4f-a926-5bcd4b810169-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (f767ec86-774b-4c1b-a0d9-a411337b8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9735c1dc-fe8c-4792-9eac-2c2f5fc78a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9735c1dc-fe8c-4792-9eac-2c2f5fc78a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583114305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c95bf4-c224-49b8-8054-1874559c82df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:36Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29b07b5-5e9f-433d-89de-d4d8524540be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29b07b5-5e9f-433d-89de-d4d8524540be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a2560c-3c11-4660-aaa4-9a60dea06cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a2560c-3c11-4660-aaa4-9a60dea06cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c95bf4-c224-49b8-8054-1874559c82df', 'volume_name': 'volume-a5c95bf4-c224-49b8-8054-1874559c82df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ba25e5-5a3c-4113-beda-6f23970cc1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ba25e5-5a3c-4113-beda-6f23970cc1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98213ce3-7a16-4254-8196-34b0f7af5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Volume a5c95bf4-c224-49b8-8054-1874559c82df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c95bf4-c224-49b8-8054-1874559c82df', 'volume_size': 1} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583114305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c95bf4-c224-49b8-8054-1874559c82df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:36Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Creating volume a5c95bf4-c224-49b8-8054-1874559c82df {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:35 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:35 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df 1073741824 Jul 09 01:12:35 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:36 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df 1073741824" returned: 0 in 1.070s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:37 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df Jul 09 01:12:37 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:37 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df" returned: 0 in 0.839s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98213ce3-7a16-4254-8196-34b0f7af5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c95bf4-c224-49b8-8054-1874559c82df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df59dfe-72a9-42d6-a3c4-62f28bb2cf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Volume volume-a5c95bf4-c224-49b8-8054-1874559c82df (a5c95bf4-c224-49b8-8054-1874559c82df): created successfully Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df59dfe-72a9-42d6-a3c4-62f28bb2cf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (f767ec86-774b-4c1b-a0d9-a411337b8a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e95c1a5e-7cce-45c3-8774-b35e4e67229f tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-a5c95bf4-c224-49b8-8054-1874559c82df-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "cinder-a5c95bf4-c224-49b8-8054-1874559c82df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-quobyte-a5c95bf4-c224-49b8-8054-1874559c82df" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-a5c95bf4-c224-49b8-8054-1874559c82df" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a16004-c7ca-4066-9149-9130247c342e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:39 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df Jul 09 01:12:39 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:40 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df" returned: 0 in 0.907s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:40 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df Jul 09 01:12:40 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:40 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5c95bf4-c224-49b8-8054-1874559c82df" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-a5c95bf4-c224-49b8-8054-1874559c82df" released by "delete_volume" :: held 1.789s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Created reservations ['a6e04ae9-bd33-4871-a1c2-aa555137fe3b', '61767de3-2339-4d4e-a36a-2fc049b00c37', '30dfe27e-1783-481d-b8a4-73966d2562cc', '02165c4b-dd72-4ff6-b56e-1e89c3b27826'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:41 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:41 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (1b3c96f3-ae30-4646-ba65-92e4e115ab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762a80e1-ebb4-47e2-a35a-e8360bbff13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762a80e1-ebb4-47e2-a35a-e8360bbff13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1579557938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194bd3b-282f-4887-9292-b29d8d02d187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:42Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f70e8-711b-4f5c-8dce-b2134327d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f70e8-711b-4f5c-8dce-b2134327d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b76b7c-f1d0-49e1-9d42-61bfb59c2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b76b7c-f1d0-49e1-9d42-61bfb59c2a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd194bd3b-282f-4887-9292-b29d8d02d187', 'volume_name': 'volume-d194bd3b-282f-4887-9292-b29d8d02d187', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8616e8-1b2a-4f02-be02-a327566b7f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8616e8-1b2a-4f02-be02-a327566b7f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007f741c-0f51-4222-8500-36c3f0b41ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Volume d194bd3b-282f-4887-9292-b29d8d02d187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d194bd3b-282f-4887-9292-b29d8d02d187', 'volume_size': 1} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1579557938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194bd3b-282f-4887-9292-b29d8d02d187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:42Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Creating volume d194bd3b-282f-4887-9292-b29d8d02d187 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:42 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:42 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 1073741824 Jul 09 01:12:42 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:42 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.269s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Deleted volume successfully. Jul 09 01:12:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0bb8f6ef-ebf4-46b5-a3c7-66d6e56a9a63 tempest-VolumesActionsTest-1366265795 None] Lock "cinder-a5c95bf4-c224-49b8-8054-1874559c82df-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:43 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 1073741824" returned: 0 in 1.140s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:43 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 Jul 09 01:12:43 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "cinder-60260b7e-6ce6-4845-a0b5-c7fb09911900-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "cinder-60260b7e-6ce6-4845-a0b5-c7fb09911900-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "cinder-quobyte-60260b7e-6ce6-4845-a0b5-c7fb09911900" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "cinder-quobyte-60260b7e-6ce6-4845-a0b5-c7fb09911900" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6d128-a444-47d5-8d42-7dd089307562]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:44 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187" returned: 0 in 1.041s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007f741c-0f51-4222-8500-36c3f0b41ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d194bd3b-282f-4887-9292-b29d8d02d187', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c53279-f875-4e14-b4bf-154ad62b1fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:44 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 Jul 09 01:12:44 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Volume volume-d194bd3b-282f-4887-9292-b29d8d02d187 (d194bd3b-282f-4887-9292-b29d8d02d187): created successfully Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c53279-f875-4e14-b4bf-154ad62b1fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (1b3c96f3-ae30-4646-ba65-92e4e115ab19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-71b1dc01-6c47-46f5-86da-649fc23898a8 tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:12:45 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900" returned: 0 in 1.202s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:45 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900 Jul 09 01:12:45 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-d194bd3b-282f-4887-9292-b29d8d02d187-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "cinder-d194bd3b-282f-4887-9292-b29d8d02d187-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-quobyte-d194bd3b-282f-4887-9292-b29d8d02d187" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-d194bd3b-282f-4887-9292-b29d8d02d187" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea98b5-4451-4416-8b97-ae446cbd7a2f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:46 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 Jul 09 01:12:46 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:46 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60260b7e-6ce6-4845-a0b5-c7fb09911900" returned: 0 in 0.911s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "cinder-quobyte-60260b7e-6ce6-4845-a0b5-c7fb09911900" released by "delete_volume" :: held 2.213s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Created reservations ['4ec0dba6-f96e-4532-b93a-db39aff7797b', '91352511-9d54-489a-beee-a9158b6a3119', '15d1f11e-0315-494b-84db-71e94190b62a', '5a4443c8-37eb-4847-a493-dd4b380e7a92'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:46 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:46 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:47 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187" returned: 0 in 1.192s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:47 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187 Jul 09 01:12:47 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:48 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.192s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Deleted volume successfully. Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-07481b1e-e226-464e-a060-0c257a98bbf8 tempest-ServerActionsTestOtherA-1159923806 None] Lock "cinder-60260b7e-6ce6-4845-a0b5-c7fb09911900-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:48 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d194bd3b-282f-4887-9292-b29d8d02d187" returned: 0 in 0.958s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-d194bd3b-282f-4887-9292-b29d8d02d187" released by "delete_volume" :: held 2.217s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Created reservations ['1a9f5831-0cde-4c32-b4c4-a27822fef959', '0e304540-3dfe-4c54-9063-2c19826c8021', 'f4109379-eee5-4ac7-8ed1-3db118282001', 'fd833666-629a-44b7-9fa7-2eb91180c270'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:48 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:48 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:49 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.764s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:49 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Deleted volume successfully. Jul 09 01:12:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f8c5c53c-fe1c-411d-8b29-b98bcbff756e tempest-VolumesActionsTest-1366265795 None] Lock "cinder-d194bd3b-282f-4887-9292-b29d8d02d187-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (9857d8ca-928f-401a-804e-4c0522361919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9eb4df-42af-4634-8769-b5661f9c3fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9eb4df-42af-4634-8769-b5661f9c3fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480561184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d019ab-e572-4c00-bb16-36205bfb0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:50Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d618e6b9-758b-4386-8685-b0a1f61f1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d618e6b9-758b-4386-8685-b0a1f61f1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7651d571-4061-4de7-950a-9649228aacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7651d571-4061-4de7-950a-9649228aacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d019ab-e572-4c00-bb16-36205bfb0431', 'volume_name': 'volume-c3d019ab-e572-4c00-bb16-36205bfb0431', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8a42c1-3c8d-4987-a543-eeba3c1aeac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8a42c1-3c8d-4987-a543-eeba3c1aeac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2660b80f-437a-4bc5-976f-5952757a01fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:50 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Volume c3d019ab-e572-4c00-bb16-36205bfb0431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d019ab-e572-4c00-bb16-36205bfb0431', 'volume_size': 1} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480561184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d019ab-e572-4c00-bb16-36205bfb0431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:50Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Creating volume c3d019ab-e572-4c00-bb16-36205bfb0431 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:50 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:50 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 1073741824 Jul 09 01:12:50 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:51 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 1073741824" returned: 0 in 1.434s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:51 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 Jul 09 01:12:51 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:52 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431" returned: 0 in 0.812s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2660b80f-437a-4bc5-976f-5952757a01fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d019ab-e572-4c00-bb16-36205bfb0431', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c9e15e-e426-4806-9f06-b8f0995df5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Volume volume-c3d019ab-e572-4c00-bb16-36205bfb0431 (c3d019ab-e572-4c00-bb16-36205bfb0431): created successfully Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c9e15e-e426-4806-9f06-b8f0995df5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (9857d8ca-928f-401a-804e-4c0522361919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e1d2ae77-3bfa-43f3-83ba-906f0d183da4 tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-c3d019ab-e572-4c00-bb16-36205bfb0431-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-c3d019ab-e572-4c00-bb16-36205bfb0431-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "cinder-quobyte-c3d019ab-e572-4c00-bb16-36205bfb0431" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-c3d019ab-e572-4c00-bb16-36205bfb0431" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26050f6-6395-4c70-99c7-5484465c73a9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:12:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:53 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 Jul 09 01:12:53 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:54 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431" returned: 0 in 0.831s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:54 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431 Jul 09 01:12:54 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:55 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c3d019ab-e572-4c00-bb16-36205bfb0431" returned: 0 in 0.770s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-quobyte-c3d019ab-e572-4c00-bb16-36205bfb0431" released by "delete_volume" :: held 1.674s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Created reservations ['02f97726-358a-4230-aa79-e2ab77f77700', 'b6ba68ac-e969-43a6-abba-0981f83216b6', '4f02a259-d18f-4676-b598-8623ac80a9e3', '2cd5e675-4ab5-4a9a-8c18-15aa290b2267'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:55 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:12:55 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:56 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:12:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Deleted volume successfully. Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-31c83b4e-1497-4ee6-9d0f-fc72143a582b tempest-VolumesActionsTest-1366265795 None] Lock "cinder-c3d019ab-e572-4c00-bb16-36205bfb0431-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (50e15a44-650d-4447-9c84-8819fe106ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be6981d-85f8-4128-8d73-6682f96fab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be6981d-85f8-4128-8d73-6682f96fab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-669057130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:57Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0311377-7466-4a9f-b5d1-405084be0783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0311377-7466-4a9f-b5d1-405084be0783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184ddc25-f0ab-436a-b7af-8f26b98cfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184ddc25-f0ab-436a-b7af-8f26b98cfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160', 'volume_name': 'volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd5dc9e-bfec-4f1c-bf22-92897836a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd5dc9e-bfec-4f1c-bf22-92897836a483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4eb2c9-bf9d-49f6-8aed-7fe3a881fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:56 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Volume 4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160', 'volume_size': 1} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-669057130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3a44f707574528b1cd004f82b9f647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:12:57Z,use_quota=True,user_id='308d07832fc24ec79e810d5689f6e2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Creating volume 4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:12:56 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:12:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:56 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 1073741824 Jul 09 01:12:56 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:57 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 1073741824" returned: 0 in 0.993s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:12:57 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 Jul 09 01:12:57 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:12:58 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" returned: 0 in 0.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4eb2c9-bf9d-49f6-8aed-7fe3a881fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec70cf-ef2a-406a-a08a-11da19cfaf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:12:58 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Volume volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 (4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160): created successfully Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec70cf-ef2a-406a-a08a-11da19cfaf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:12:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Flow 'volume_create_manager' (50e15a44-650d-4447-9c84-8819fe106ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:12:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8ed0fc49-8378-4e7e-9b2a-0cc9c1eb0ae1 tempest-VolumesActionsTest-1704887736 None] Created volume successfully. Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Acquiring lock "cinder-quobyte-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "cinder-quobyte-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d749023-dacf-466a-ba56-f8913935f6dd]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:00 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 Jul 09 01:13:00 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:02 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" returned: 0 in 1.200s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:02 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160 Jul 09 01:13:02 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:02 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" returned: 0 in 0.863s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "cinder-quobyte-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160" released by "delete_volume" :: held 2.135s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=18,cinder:DELETE=9 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=59,cinder:UPDATE=95,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:13:02 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Created reservations ['54057820-b128-4897-bdfe-0df87904f446', 'fe291955-8eb5-4d4d-986a-5d409e2573ea', 'e70a7ba1-b67f-4164-9003-c52995c0296e', 'e49445c5-8db1-42f5-8a99-d2c92446d091'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:03 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:03 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:03 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.690s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Deleted volume successfully. Jul 09 01:13:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c45d4ee1-8d1a-4b96-a5c5-fdabab73649c tempest-VolumesActionsTest-1704887736 None] Lock "cinder-4c248612-e5ac-4d2f-a2b7-f9cfbb7a7160-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (bac9aef8-9747-443a-93df-182d2a08791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b573bda-f67d-4134-bf5f-0024ee063a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b573bda-f67d-4134-bf5f-0024ee063a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-353708921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c8736-e781-4d75-bbe8-726ef33e8954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:06Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dcfbcd-a079-4510-a3fd-92793b4aecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dcfbcd-a079-4510-a3fd-92793b4aecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc48b1a-380e-4461-8eac-2dae0cc340fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc48b1a-380e-4461-8eac-2dae0cc340fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8c8736-e781-4d75-bbe8-726ef33e8954', 'volume_name': 'volume-fa8c8736-e781-4d75-bbe8-726ef33e8954', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7570cd-a0af-46db-8668-ab2e4f04fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7570cd-a0af-46db-8668-ab2e4f04fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2248303-3803-40ff-8f3a-058bc008977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Volume fa8c8736-e781-4d75-bbe8-726ef33e8954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8c8736-e781-4d75-bbe8-726ef33e8954', 'volume_size': 1} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-353708921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c8736-e781-4d75-bbe8-726ef33e8954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:06Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Creating volume fa8c8736-e781-4d75-bbe8-726ef33e8954 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:06 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:06 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 1073741824 Jul 09 01:13:06 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:07 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 1073741824" returned: 0 in 1.246s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:07 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 Jul 09 01:13:07 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:08 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2248303-3803-40ff-8f3a-058bc008977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8c8736-e781-4d75-bbe8-726ef33e8954', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6005557-9d60-4d1b-a2c3-8bb346999d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Volume volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 (fa8c8736-e781-4d75-bbe8-726ef33e8954): created successfully Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6005557-9d60-4d1b-a2c3-8bb346999d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (bac9aef8-9747-443a-93df-182d2a08791f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-54976f55-41e9-4531-a7d6-29db8b06c939 tempest-AttachVolumeNegativeTest-1699498806 None] Created volume successfully. Jul 09 01:13:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec5d3ec-1266-485d-86cc-bed3cbc00066]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:13 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 Jul 09 01:13:13 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:13 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954" returned: 0 in 0.957s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-fa8c8736-e781-4d75-bbe8-726ef33e8954', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '739ed315-0482-4e52-ba8d-7c4db3fbf6ef', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:13:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-a3180424-b1e9-4b13-9214-5d38f3a8d4d5 req-e860ec30-b6fd-4bab-8b1c-563414c43681 tempest-AttachVolumeNegativeTest-1699498806 None] attachment_update completed successfully. Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (94ee748b-6501-450c-b700-d7ea5d9d2144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee09e48-e262-48af-8f0c-b5d962766fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee09e48-e262-48af-8f0c-b5d962766fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882378688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:20Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ea5e1-cab7-4261-8394-52aa647a6de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ea5e1-cab7-4261-8394-52aa647a6de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a092c66-a8bb-4fcc-b47f-2b1536d472c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a092c66-a8bb-4fcc-b47f-2b1536d472c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d', 'volume_name': 'volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6d62c2-8f0e-4756-bbc7-bb34acd53d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6d62c2-8f0e-4756-bbc7-bb34acd53d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb66caf-a32f-4093-8568-f827f87ef9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Volume b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d', 'volume_size': 1} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882378688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:20Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Creating volume b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:20 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:20 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d 1073741824 Jul 09 01:13:20 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-3219a1c0-e6cf-4c3b-b119-a5a73008a784 req-933f5a0e-9e60-4448-a37c-6f774d50cb5d tempest-AttachVolumeNegativeTest-1699498806 None] Terminate volume connection completed successfully. Jul 09 01:13:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-3219a1c0-e6cf-4c3b-b119-a5a73008a784 req-933f5a0e-9e60-4448-a37c-6f774d50cb5d tempest-AttachVolumeNegativeTest-1699498806 None] Deleting attachment 739ed315-0482-4e52-ba8d-7c4db3fbf6ef. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:13:21 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d 1073741824" returned: 0 in 1.137s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:21 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d Jul 09 01:13:21 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:22 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb66caf-a32f-4093-8568-f827f87ef9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d33088e-879b-4b02-ac67-9eb5727c429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Volume volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d (b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d): created successfully Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d33088e-879b-4b02-ac67-9eb5727c429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (94ee748b-6501-450c-b700-d7ea5d9d2144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f853a8c5-4465-494e-9f01-660e41e22629 tempest-VolumesListAdminTestJSON-621218931 None] Created volume successfully. Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (bd980e12-a01f-43c7-8846-4f82ba37f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ff55b4-a84e-46f8-af58-57d3502012b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ff55b4-a84e-46f8-af58-57d3502012b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-897053891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6563a642-8a8a-4eba-9893-c5780b4e95b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:24Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fecf5f3-fcf1-46ef-99bf-959bc1bc419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fecf5f3-fcf1-46ef-99bf-959bc1bc419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe474aa0-2983-4e5f-ab98-9534f4b6d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe474aa0-2983-4e5f-ab98-9534f4b6d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6563a642-8a8a-4eba-9893-c5780b4e95b1', 'volume_name': 'volume-6563a642-8a8a-4eba-9893-c5780b4e95b1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ae830-1d0e-45cf-9a5a-89ad8f8853ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ae830-1d0e-45cf-9a5a-89ad8f8853ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbb79b4-12d3-41d4-9d1d-84563cb7e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Volume 6563a642-8a8a-4eba-9893-c5780b4e95b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6563a642-8a8a-4eba-9893-c5780b4e95b1', 'volume_size': 1} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-897053891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6563a642-8a8a-4eba-9893-c5780b4e95b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:24Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Creating volume 6563a642-8a8a-4eba-9893-c5780b4e95b1 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:24 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:24 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 1073741824 Jul 09 01:13:24 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:25 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 1073741824" returned: 0 in 1.214s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:26 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 Jul 09 01:13:26 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:26 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1" returned: 0 in 0.898s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbb79b4-12d3-41d4-9d1d-84563cb7e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6563a642-8a8a-4eba-9893-c5780b4e95b1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a940e7f-157b-49d2-b668-a8ed7e9a1b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Volume volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 (6563a642-8a8a-4eba-9893-c5780b4e95b1): created successfully Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a940e7f-157b-49d2-b668-a8ed7e9a1b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (bd980e12-a01f-43c7-8846-4f82ba37f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-cb56a77b-bd87-4fdf-9a8d-23da98bfbc7e tempest-VolumesListAdminTestJSON-621218931 None] Created volume successfully. Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (d6f78b60-6f0f-4751-9fc4-497d3b780326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c94af7-a9e9-4565-b5ce-a3cce1138659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c94af7-a9e9-4565-b5ce-a3cce1138659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264628729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74588782-0c50-490e-8eca-64717da3280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:29Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c461aa-63e2-44f0-ae2e-3ebef9508734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c461aa-63e2-44f0-ae2e-3ebef9508734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b49053-db11-409d-a0ec-18b0e236c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b49053-db11-409d-a0ec-18b0e236c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74588782-0c50-490e-8eca-64717da3280e', 'volume_name': 'volume-74588782-0c50-490e-8eca-64717da3280e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036ca3f4-1edd-4252-9652-b022cba2e757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036ca3f4-1edd-4252-9652-b022cba2e757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35b384-a786-4c7b-b95a-3aa2da9b9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:28 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Volume 74588782-0c50-490e-8eca-64717da3280e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74588782-0c50-490e-8eca-64717da3280e', 'volume_size': 1} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264628729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74588782-0c50-490e-8eca-64717da3280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a675b265594a6c97bd9b2a61e1b987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:29Z,use_quota=True,user_id='cbd590575ee240ebb73fca7e7c865b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Creating volume 74588782-0c50-490e-8eca-64717da3280e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:28 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:28 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e 1073741824 Jul 09 01:13:28 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:29 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e 1073741824" returned: 0 in 1.172s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:30 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e Jul 09 01:13:30 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:31 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e" returned: 0 in 1.571s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] <== create_volume: return (2791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.793s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35b384-a786-4c7b-b95a-3aa2da9b9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74588782-0c50-490e-8eca-64717da3280e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1053bd2f-8f19-488d-a68b-e57b248dbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:31 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Volume volume-74588782-0c50-490e-8eca-64717da3280e (74588782-0c50-490e-8eca-64717da3280e): created successfully Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1053bd2f-8f19-488d-a68b-e57b248dbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Flow 'volume_create_manager' (d6f78b60-6f0f-4751-9fc4-497d3b780326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e7cc9320-706e-4f0c-9603-1c5d40cfa94f tempest-VolumesListAdminTestJSON-621218931 None] Created volume successfully. Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Flow 'volume_create_manager' (bb68bfcd-7acc-4b2b-b5db-ee874cf9a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b889818-2362-4757-be2d-9d9d768eee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b889818-2362-4757-be2d-9d9d768eee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dfb20b-976c-4b33-924b-040ae536e5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f4d0c0f6e44a7b7d15e9e398291cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:33Z,use_quota=True,user_id='ef0748ab0433483ca7723d749d32a00e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197f0f7f-5374-4394-9d21-83cdfa217bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197f0f7f-5374-4394-9d21-83cdfa217bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69cb327-e7a9-45ef-a87e-4670754f6a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69cb327-e7a9-45ef-a87e-4670754f6a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dfb20b-976c-4b33-924b-040ae536e5a0', 'volume_name': 'volume-69dfb20b-976c-4b33-924b-040ae536e5a0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b3f1e-d45c-4324-afab-c0386e6a0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b3f1e-d45c-4324-afab-c0386e6a0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37333181-1248-4cd4-b7a6-f810946cb1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Volume 69dfb20b-976c-4b33-924b-040ae536e5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dfb20b-976c-4b33-924b-040ae536e5a0', 'volume_size': 1} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dfb20b-976c-4b33-924b-040ae536e5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f4d0c0f6e44a7b7d15e9e398291cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:33Z,use_quota=True,user_id='ef0748ab0433483ca7723d749d32a00e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Creating volume 69dfb20b-976c-4b33-924b-040ae536e5a0 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:33 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:33 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 1073741824 Jul 09 01:13:33 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:33 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:33 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:36 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 1073741824" returned: 0 in 2.933s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:36 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 2.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:36 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 Jul 09 01:13:36 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 8 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:13:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:13:37 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0" returned: 0 in 1.402s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] <== create_volume: return (4481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.489s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37333181-1248-4cd4-b7a6-f810946cb1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dfb20b-976c-4b33-924b-040ae536e5a0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2833708-3b5f-41d7-adce-efd40823e01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Volume volume-69dfb20b-976c-4b33-924b-040ae536e5a0 (69dfb20b-976c-4b33-924b-040ae536e5a0): created successfully Jul 09 01:13:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2833708-3b5f-41d7-adce-efd40823e01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Flow 'volume_create_manager' (bb68bfcd-7acc-4b2b-b5db-ee874cf9a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b4302fe8-6ec1-481d-9a4a-df216e2e466d tempest-VolumesListAdminTestJSON-1347260032 None] Created volume successfully. Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Acquiring lock "cinder-69dfb20b-976c-4b33-924b-040ae536e5a0-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "cinder-69dfb20b-976c-4b33-924b-040ae536e5a0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Acquiring lock "cinder-quobyte-69dfb20b-976c-4b33-924b-040ae536e5a0" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "cinder-quobyte-69dfb20b-976c-4b33-924b-040ae536e5a0" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa72e9a-19a0-49d1-bd78-d11e4ff2e9a4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-74588782-0c50-490e-8eca-64717da3280e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-74588782-0c50-490e-8eca-64717da3280e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:40 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 Jul 09 01:13:40 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-quobyte-74588782-0c50-490e-8eca-64717da3280e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-74588782-0c50-490e-8eca-64717da3280e" acquired by "delete_volume" :: waited 0.082s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8dd0b3-eae0-4457-ac80-cc0d7f915346]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:40 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e Jul 09 01:13:40 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:42 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0" returned: 0 in 2.251s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:42 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0 Jul 09 01:13:42 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:42 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e" returned: 0 in 1.928s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:42 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e Jul 09 01:13:42 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:43 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-74588782-0c50-490e-8eca-64717da3280e" returned: 0 in 1.384s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-74588782-0c50-490e-8eca-64717da3280e" released by "delete_volume" :: held 3.417s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:43 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69dfb20b-976c-4b33-924b-040ae536e5a0" returned: 0 in 1.712s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "cinder-quobyte-69dfb20b-976c-4b33-924b-040ae536e5a0" released by "delete_volume" :: held 4.042s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Created reservations ['7bece6ab-c97c-4662-9470-4c518040aa4c', '6a12e30b-45e8-48b8-b2f7-709370a76c12', 'd2de566f-740a-48ce-9b60-0486a15cf13b', '1c613555-906a-4caa-bd13-2db94a5a372c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Created reservations ['8c005dd1-1204-4bad-bfaa-bcd12ef235da', '8e1d1511-4a49-4e23-94d2-34523be97e37', '03c1f809-f219-45b1-ad6a-6b6100fb09cf', '0e434f2c-2939-4f82-86ec-334c953f84b4'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:13:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:44 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:44 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:44 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:44 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-6563a642-8a8a-4eba-9893-c5780b4e95b1-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-6563a642-8a8a-4eba-9893-c5780b4e95b1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:45 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.251s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-quobyte-6563a642-8a8a-4eba-9893-c5780b4e95b1" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Deleted volume successfully. Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-6563a642-8a8a-4eba-9893-c5780b4e95b1" acquired by "delete_volume" :: waited 0.048s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6dff3d24-6ba2-4d64-b3b5-1f5730661e94 tempest-VolumesListAdminTestJSON-1347260032 None] Lock "cinder-69dfb20b-976c-4b33-924b-040ae536e5a0-delete_volume" released by "delete_volume" :: held 5.922s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6f0e3-e066-434c-a80e-e9a14399f752]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:45 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Deleted volume successfully. Jul 09 01:13:45 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 Jul 09 01:13:45 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98781472-57c5-4979-ab0d-a9c0ee721051 tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-74588782-0c50-490e-8eca-64717da3280e-delete_volume" released by "delete_volume" :: held 5.912s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:46 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1" returned: 0 in 1.106s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:46 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1 Jul 09 01:13:46 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:47 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6563a642-8a8a-4eba-9893-c5780b4e95b1" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-6563a642-8a8a-4eba-9893-c5780b4e95b1" released by "delete_volume" :: held 1.915s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Created reservations ['fcf32aae-b172-4f08-8b54-daf38abdc01c', '693489a6-f300-4a36-a057-bc9868273b25', 'd661beae-5fbe-44bb-a237-76b8faa49114', '9f519219-8a0e-4e63-ba37-29b019e68aa0'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:47 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:47 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "cinder-quobyte-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0af266f-4161-4e41-85fc-685dcbe5bc7b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:48 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d Jul 09 01:13:48 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:48 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.145s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Deleted volume successfully. Jul 09 01:13:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7c6d02bd-c142-4345-97f7-136ee2cb597f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-6563a642-8a8a-4eba-9893-c5780b4e95b1-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:49 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" returned: 0 in 1.042s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:49 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d Jul 09 01:13:49 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:49 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-quobyte-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d" released by "delete_volume" :: held 1.891s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Created reservations ['71e965b9-15a6-4052-b1da-329e00ba7ffa', 'e3c643a8-b14a-47ed-ae4e-0199862bae70', '8623d566-fb97-4a35-b83c-af2e43aa9f4d', '98e15012-a034-47cf-9f60-5cd561eca6ce'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:50 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:13:50 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:50 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:13:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Deleted volume successfully. Jul 09 01:13:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-73e8dbcd-4d9d-4f2b-b5bb-92e560380e0f tempest-VolumesListAdminTestJSON-621218931 None] Lock "cinder-b4b5af0a-dba0-42cb-b80b-ef5a035ffc9d-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (422566fe-427b-443f-b3fa-b188dd900988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58027d20-f7bf-47ca-a913-02796af99bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58027d20-f7bf-47ca-a913-02796af99bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1454105365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:53Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb1fdf0-4b0e-4051-815e-c37c59dcd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb1fdf0-4b0e-4051-815e-c37c59dcd76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27382e-e4d1-4475-ac21-aea1564c1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27382e-e4d1-4475-ac21-aea1564c1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f', 'volume_name': 'volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d154b5f5-f796-44fb-95ab-cd528f685976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d154b5f5-f796-44fb-95ab-cd528f685976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7909fddf-cfc6-4cf9-9228-2e5f294e4833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Volume 31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f', 'volume_size': 1} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1454105365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:53Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Creating volume 31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:52 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:52 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f 1073741824 Jul 09 01:13:52 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:54 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f 1073741824" returned: 0 in 1.439s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:54 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f Jul 09 01:13:54 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:55 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" returned: 0 in 1.077s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7909fddf-cfc6-4cf9-9228-2e5f294e4833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc6a24-7d05-426b-be78-15f79f2a925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Volume volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f (31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f): created successfully Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc6a24-7d05-426b-be78-15f79f2a925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (422566fe-427b-443f-b3fa-b188dd900988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0ad89ea9-426d-44aa-8cc3-6b7338f0392d tempest-AttachVolumeTestJSON-1231346191 None] Created volume successfully. Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Flow 'volume_create_manager' (4c8e06c3-f4fa-48a2-8535-cabae82711fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6d7fc7-5a8b-409b-83ba-8ee5eb092e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6d7fc7-5a8b-409b-83ba-8ee5eb092e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-531991346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755cfbb3-3822-46f4-8cc6-2233707bc6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784dced5919245bb9eb65d039adbe3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:56Z,use_quota=True,user_id='5f0faa64e67148d59b782196618eea2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd29166-33dc-4f0c-95fa-e16b95f7fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd29166-33dc-4f0c-95fa-e16b95f7fce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0340e1f6-6d8e-476d-842b-c5ff19588d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0340e1f6-6d8e-476d-842b-c5ff19588d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755cfbb3-3822-46f4-8cc6-2233707bc6ff', 'volume_name': 'volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431885cc-e78e-4154-9844-6e1892e0a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431885cc-e78e-4154-9844-6e1892e0a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151e6eb-9cb7-4285-8632-ead07e0bdb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:55 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Volume 755cfbb3-3822-46f4-8cc6-2233707bc6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff', 'volume_size': 1} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-531991346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755cfbb3-3822-46f4-8cc6-2233707bc6ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784dced5919245bb9eb65d039adbe3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:13:56Z,use_quota=True,user_id='5f0faa64e67148d59b782196618eea2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Creating volume 755cfbb3-3822-46f4-8cc6-2233707bc6ff {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:13:55 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:13:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:55 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff 1073741824 Jul 09 01:13:55 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:57 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff 1073741824" returned: 0 in 1.226s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:13:57 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff Jul 09 01:13:57 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:13:58 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff" returned: 0 in 1.348s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] <== create_volume: return (2685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.689s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151e6eb-9cb7-4285-8632-ead07e0bdb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a175bfe-281e-4341-8792-047510b77a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:13:58 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Volume volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff (755cfbb3-3822-46f4-8cc6-2233707bc6ff): created successfully Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a175bfe-281e-4341-8792-047510b77a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:13:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Flow 'volume_create_manager' (4c8e06c3-f4fa-48a2-8535-cabae82711fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:13:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-29136987-d5f5-416a-b077-555302822a64 tempest-ServerRescueNegativeTestJSON-2047033595 None] Created volume successfully. Jul 09 01:14:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[976da17f-8651-43bb-8274-8f6e5a010982]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:01 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f Jul 09 01:14:01 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:03 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" returned: 0 in 1.634s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.682s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:03 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=49,cinder:INSERT=15,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:14:03 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=58,cinder:SELECT=42,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:14:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f7ad13-1312-4037-bcc7-192cc0f880e7', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:14:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-701dbe9e-83f3-4bf9-b123-9d9cf5f0a230 req-ba7272a3-63d5-4d79-a9bb-6b19d712532e tempest-AttachVolumeTestJSON-1231346191 None] attachment_update completed successfully. Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Flow 'volume_create_manager' (f73971a3-90d1-45e5-bb14-fc47685a28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0fc02f-8811-4631-913e-8a91cb6842b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0fc02f-8811-4631-913e-8a91cb6842b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1924693800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe21bc8-37b6-40a2-a20d-665602964f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7759d27f1b6b495ca974ec82ea258ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:08Z,use_quota=True,user_id='91dc007e641f4feebcbb65d1e0e80fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb879ab6-275d-405a-a553-134702027e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb879ab6-275d-405a-a553-134702027e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb0197c-80af-4e1b-aa02-09eb40dea9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb0197c-80af-4e1b-aa02-09eb40dea9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe21bc8-37b6-40a2-a20d-665602964f4d', 'volume_name': 'volume-cfe21bc8-37b6-40a2-a20d-665602964f4d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faab135d-b2ec-4e4d-a0a2-761663d3523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faab135d-b2ec-4e4d-a0a2-761663d3523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be1e569-52df-4d8a-a3d7-d2f9e94ecc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Volume cfe21bc8-37b6-40a2-a20d-665602964f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe21bc8-37b6-40a2-a20d-665602964f4d', 'volume_size': 1} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1924693800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe21bc8-37b6-40a2-a20d-665602964f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7759d27f1b6b495ca974ec82ea258ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:08Z,use_quota=True,user_id='91dc007e641f4feebcbb65d1e0e80fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Creating volume cfe21bc8-37b6-40a2-a20d-665602964f4d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:14:08 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:14:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:08 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d 1073741824 Jul 09 01:14:08 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:09 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d 1073741824" returned: 0 in 1.059s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:09 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d Jul 09 01:14:09 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:10 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d" returned: 0 in 0.776s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be1e569-52df-4d8a-a3d7-d2f9e94ecc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe21bc8-37b6-40a2-a20d-665602964f4d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55ca32a-bc82-40b5-b9de-463db1782ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:10 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Volume volume-cfe21bc8-37b6-40a2-a20d-665602964f4d (cfe21bc8-37b6-40a2-a20d-665602964f4d): created successfully Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55ca32a-bc82-40b5-b9de-463db1782ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Flow 'volume_create_manager' (f73971a3-90d1-45e5-bb14-fc47685a28e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-35d9695d-a71b-43af-8ef0-83d75afc64a5 tempest-AbsoluteLimitsTests-1126190075 None] Created volume successfully. Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Acquiring lock "cinder-cfe21bc8-37b6-40a2-a20d-665602964f4d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "cinder-cfe21bc8-37b6-40a2-a20d-665602964f4d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Acquiring lock "cinder-quobyte-cfe21bc8-37b6-40a2-a20d-665602964f4d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "cinder-quobyte-cfe21bc8-37b6-40a2-a20d-665602964f4d" acquired by "delete_volume" :: waited 0.038s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7093c9e-a6ad-43ac-851b-43691be0561f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:12 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d Jul 09 01:14:12 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:13 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d" returned: 0 in 1.263s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:13 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d Jul 09 01:14:13 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:14 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-cfe21bc8-37b6-40a2-a20d-665602964f4d" returned: 0 in 1.207s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "cinder-quobyte-cfe21bc8-37b6-40a2-a20d-665602964f4d" released by "delete_volume" :: held 2.550s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Created reservations ['95cb142d-ea7f-467a-a6cb-a4013298353a', '8d57b4de-50a3-49d6-8ead-daa7e866d3ab', '26d2419e-2b74-4f53-a9a8-9f8ad35e0be6', '152b83d5-0848-42b2-911c-ef578f1e5528'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:14 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:14 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:15 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.841s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:15 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Deleted volume successfully. Jul 09 01:14:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27765ce6-0fbb-4ef6-b9b7-c3ab250b0317 tempest-AbsoluteLimitsTests-1126190075 None] Lock "cinder-cfe21bc8-37b6-40a2-a20d-665602964f4d-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Acquiring lock "cinder-755cfbb3-3822-46f4-8cc6-2233707bc6ff-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "cinder-755cfbb3-3822-46f4-8cc6-2233707bc6ff-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Acquiring lock "cinder-quobyte-755cfbb3-3822-46f4-8cc6-2233707bc6ff" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "cinder-quobyte-755cfbb3-3822-46f4-8cc6-2233707bc6ff" acquired by "delete_volume" :: waited 0.049s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6a036-eefe-4bca-87f2-f137ae0efd55]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:18 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff Jul 09 01:14:18 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:19 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff" returned: 0 in 1.162s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:19 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff Jul 09 01:14:19 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:20 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-755cfbb3-3822-46f4-8cc6-2233707bc6ff" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "cinder-quobyte-755cfbb3-3822-46f4-8cc6-2233707bc6ff" released by "delete_volume" :: held 1.982s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Created reservations ['845fd47c-21c1-4504-89a4-82b12f10bff8', 'f8a41558-68a8-4dd6-9781-63018d8858b2', '751c6f4c-48e5-4387-9f03-dfa219d7b3b8', '1a57523d-8200-4a32-be4f-8225fb88c484'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:20 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:20 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:21 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.230s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:21 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Deleted volume successfully. Jul 09 01:14:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-454edc49-f241-4e2c-b526-574e3f87ee2e tempest-ServerRescueNegativeTestJSON-2047033595 None] Lock "cinder-755cfbb3-3822-46f4-8cc6-2233707bc6ff-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Flow 'volume_create_manager' (2120576d-3884-4b88-a890-e6dad07e16a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4829fc9f-0a02-47a1-9a44-72a6ecfcd34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4829fc9f-0a02-47a1-9a44-72a6ecfcd34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1904007202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7e91e-9197-4582-8cfa-672284744109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215f07986f0745ad96c49e32cdf4aedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:25Z,use_quota=True,user_id='f835c01bffdc43ee98f37cebb2236119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98120ba2-3227-458b-ba18-0690271ba279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98120ba2-3227-458b-ba18-0690271ba279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced3e76e-62d7-4b38-87e8-e63beed3216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced3e76e-62d7-4b38-87e8-e63beed3216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c7e91e-9197-4582-8cfa-672284744109', 'volume_name': 'volume-61c7e91e-9197-4582-8cfa-672284744109', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0462606-d307-48fa-a041-efdd5a12b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0462606-d307-48fa-a041-efdd5a12b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3ef5e-27be-40b6-8267-c8a05dec762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Volume 61c7e91e-9197-4582-8cfa-672284744109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c7e91e-9197-4582-8cfa-672284744109', 'volume_size': 1} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1904007202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7e91e-9197-4582-8cfa-672284744109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215f07986f0745ad96c49e32cdf4aedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:25Z,use_quota=True,user_id='f835c01bffdc43ee98f37cebb2236119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Creating volume 61c7e91e-9197-4582-8cfa-672284744109 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:14:25 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:14:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:25 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 1073741824 Jul 09 01:14:25 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:26 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 1073741824" returned: 0 in 1.389s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (5ca3a984-e4e1-4622-a2f1-e32cfb576027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc62b6e7-ef21-4f61-a772-e8f77abf6626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc62b6e7-ef21-4f61-a772-e8f77abf6626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-397922417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5810d1ec-078a-4e97-9a92-0e32479d9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:27Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b994ff3-fdc6-401e-8a31-d874d59b000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b994ff3-fdc6-401e-8a31-d874d59b000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ce83b5-4d7c-46ed-918c-7a8e3fe4b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ce83b5-4d7c-46ed-918c-7a8e3fe4b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5810d1ec-078a-4e97-9a92-0e32479d9557', 'volume_name': 'volume-5810d1ec-078a-4e97-9a92-0e32479d9557', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c90b6ce-f392-40fc-a923-bf4acb4bc39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c90b6ce-f392-40fc-a923-bf4acb4bc39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb53a84-6758-468b-acd7-8f300ae71e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Volume 5810d1ec-078a-4e97-9a92-0e32479d9557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5810d1ec-078a-4e97-9a92-0e32479d9557', 'volume_size': 1} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:26 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 Jul 09 01:14:26 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:27 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109" returned: 0 in 0.754s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.412s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-397922417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5810d1ec-078a-4e97-9a92-0e32479d9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db51dfef2f4590acc518cc0711ea12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:27Z,use_quota=True,user_id='2e6e1a2fb4fd45de8a0b0c29ba40f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Creating volume 5810d1ec-078a-4e97-9a92-0e32479d9557 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:14:27 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3ef5e-27be-40b6-8267-c8a05dec762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c7e91e-9197-4582-8cfa-672284744109', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:27 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 1073741824 Jul 09 01:14:27 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cbd845-5cd1-486e-8377-33f93e32b7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Volume volume-61c7e91e-9197-4582-8cfa-672284744109 (61c7e91e-9197-4582-8cfa-672284744109): created successfully Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cbd845-5cd1-486e-8377-33f93e32b7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Flow 'volume_create_manager' (2120576d-3884-4b88-a890-e6dad07e16a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c065185f-10a4-40a9-829e-63307f13974b tempest-VolumesTransfersTest-252905951 None] Created volume successfully. Jul 09 01:14:28 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 1073741824" returned: 0 in 1.253s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8d0d1ad9-8e0c-4711-83ec-692308f8af06 tempest-VolumesTransfersTest-2099412376 None] Transfer volume completed successfully. Jul 09 01:14:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:29 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 Jul 09 01:14:29 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:29 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557" returned: 0 in 0.648s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb53a84-6758-468b-acd7-8f300ae71e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5810d1ec-078a-4e97-9a92-0e32479d9557', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e20ab5-442c-443f-b988-ace160db7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:29 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Volume volume-5810d1ec-078a-4e97-9a92-0e32479d9557 (5810d1ec-078a-4e97-9a92-0e32479d9557): created successfully Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e20ab5-442c-443f-b988-ace160db7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Flow 'volume_create_manager' (5ca3a984-e4e1-4622-a2f1-e32cfb576027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ff9341e5-482a-4939-80fb-dd0b99fa9fbe tempest-AttachVolumeNegativeTest-1699498806 None] Created volume successfully. Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Acquiring lock "cinder-61c7e91e-9197-4582-8cfa-672284744109-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "cinder-61c7e91e-9197-4582-8cfa-672284744109-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Acquiring lock "cinder-quobyte-61c7e91e-9197-4582-8cfa-672284744109" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "cinder-quobyte-61c7e91e-9197-4582-8cfa-672284744109" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc06a9b-f29e-4aa1-bead-088fb1ccff95]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:30 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 Jul 09 01:14:30 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:30 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109" returned: 0 in 0.829s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:31 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109 Jul 09 01:14:31 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:31 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61c7e91e-9197-4582-8cfa-672284744109" returned: 0 in 0.704s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "cinder-quobyte-61c7e91e-9197-4582-8cfa-672284744109" released by "delete_volume" :: held 1.596s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Created reservations ['8a7262b9-7846-4514-9ec4-e28bb5424b34', '58002249-00cc-4db5-b292-db69ef96943b', '0245206a-6059-4995-8622-9b00479a6393', '6b12299f-492a-4fb0-aac4-4e39103fa317'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:31 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:31 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:32 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.071s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:32 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Deleted volume successfully. Jul 09 01:14:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e217294c-e58d-4d17-91e1-076db76c1d1d tempest-VolumesTransfersTest-722661408 None] Lock "cinder-61c7e91e-9197-4582-8cfa-672284744109-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Flow 'volume_create_manager' (9eafd804-5dc2-46d2-9dff-3b6e92476e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e3d8e-e1e7-486c-a1f7-a0ae54996a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e3d8e-e1e7-486c-a1f7-a0ae54996a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1863446941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4b8e6f-ac05-450a-9621-00e5a641757f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215f07986f0745ad96c49e32cdf4aedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:33Z,use_quota=True,user_id='f835c01bffdc43ee98f37cebb2236119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3607b624-2e42-44d7-bed2-891e91f1a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3607b624-2e42-44d7-bed2-891e91f1a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e83018-2442-4a54-9520-52e024ba12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e83018-2442-4a54-9520-52e024ba12a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4b8e6f-ac05-450a-9621-00e5a641757f', 'volume_name': 'volume-8c4b8e6f-ac05-450a-9621-00e5a641757f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef8483-88e1-448f-a91b-69e28bc770f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef8483-88e1-448f-a91b-69e28bc770f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5fb244-230b-4dca-850a-0a8903994ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Volume 8c4b8e6f-ac05-450a-9621-00e5a641757f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4b8e6f-ac05-450a-9621-00e5a641757f', 'volume_size': 1} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1863446941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4b8e6f-ac05-450a-9621-00e5a641757f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215f07986f0745ad96c49e32cdf4aedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:33Z,use_quota=True,user_id='f835c01bffdc43ee98f37cebb2236119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Creating volume 8c4b8e6f-ac05-450a-9621-00e5a641757f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:14:33 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:33 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f 1073741824 Jul 09 01:14:33 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:33 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:33 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:34 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f 1073741824" returned: 0 in 1.040s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:34 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f Jul 09 01:14:34 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:34 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.867s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 8 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:14:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:14:35 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.679s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5fb244-230b-4dca-850a-0a8903994ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4b8e6f-ac05-450a-9621-00e5a641757f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f155f867-aded-4ab8-bd7b-54fa5c301973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[81056bc6-8407-46cd-ad3d-966079a7d2f1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Volume volume-8c4b8e6f-ac05-450a-9621-00e5a641757f (8c4b8e6f-ac05-450a-9621-00e5a641757f): created successfully Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f155f867-aded-4ab8-bd7b-54fa5c301973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Flow 'volume_create_manager' (9eafd804-5dc2-46d2-9dff-3b6e92476e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f0889060-ae2c-473a-a8b4-4e42f0329350 tempest-VolumesTransfersTest-252905951 None] Created volume successfully. Jul 09 01:14:35 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 Jul 09 01:14:35 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:36 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557" returned: 0 in 0.979s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-5810d1ec-078a-4e97-9a92-0e32479d9557', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7233cd26-f899-4cff-b106-2712d3167d87', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:14:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-de7448c9-1141-4ec5-8b35-19e3d50803be req-627cc1cf-b51a-453f-a868-39671289a663 tempest-AttachVolumeNegativeTest-1699498806 None] attachment_update completed successfully. Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Acquiring lock "cinder-8c4b8e6f-ac05-450a-9621-00e5a641757f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "cinder-8c4b8e6f-ac05-450a-9621-00e5a641757f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Acquiring lock "cinder-quobyte-8c4b8e6f-ac05-450a-9621-00e5a641757f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "cinder-quobyte-8c4b8e6f-ac05-450a-9621-00e5a641757f" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c26fc-5f07-40cb-9234-e8f511d9b780]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:37 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f Jul 09 01:14:37 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:38 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f" returned: 0 in 1.089s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:38 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f Jul 09 01:14:38 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:38 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c4b8e6f-ac05-450a-9621-00e5a641757f" returned: 0 in 0.870s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "cinder-quobyte-8c4b8e6f-ac05-450a-9621-00e5a641757f" released by "delete_volume" :: held 2.026s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Created reservations ['d8a1ec4e-af0d-4453-9f29-eaa75dd18301', 'dd487e30-4b19-45f8-9907-afbf02d12fb4', '5f362695-dbb9-4946-b6ba-3d27229acd7a', '78c111a1-2fee-4e0e-9dfb-d511b10f6aaa'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:39 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:39 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:39 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.787s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Deleted volume successfully. Jul 09 01:14:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7ed33a2e-32b5-486d-88ce-3a4078247177 tempest-VolumesTransfersTest-722661408 None] Lock "cinder-8c4b8e6f-ac05-450a-9621-00e5a641757f-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-0702085b-3b06-446c-9304-8c267dd25ffe req-9a5f249a-1c95-45dc-9549-6076375065f3 tempest-AttachVolumeNegativeTest-1699498806 None] Terminate volume connection completed successfully. Jul 09 01:14:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0702085b-3b06-446c-9304-8c267dd25ffe req-9a5f249a-1c95-45dc-9549-6076375065f3 tempest-AttachVolumeNegativeTest-1699498806 None] Deleting attachment 7233cd26-f899-4cff-b106-2712d3167d87. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Flow 'volume_create_manager' (c69e6048-b57a-4f65-9b6e-0e90869cfccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262ceccf-9b83-48fa-aa8c-7d51093d0892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262ceccf-9b83-48fa-aa8c-7d51093d0892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-445448151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f574670-2585-4670-ab06-16c5d481b91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791a54b01e54bca9a2e6a3d883fdb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:46Z,use_quota=True,user_id='750dc51486724daca5fecd779b77ec85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a46bf-e3b7-47fe-ba7c-0ae895f05e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a46bf-e3b7-47fe-ba7c-0ae895f05e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666bd9c8-97a5-4e0c-8af9-5908ecf51f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:46 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666bd9c8-97a5-4e0c-8af9-5908ecf51f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f574670-2585-4670-ab06-16c5d481b91d', 'volume_name': 'volume-4f574670-2585-4670-ab06-16c5d481b91d', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e073976c-3111-4a0f-bf5b-44a8343c96f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e073976c-3111-4a0f-bf5b-44a8343c96f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fa6cc1-93df-432f-ba4a-206478f43d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:47 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Volume 4f574670-2585-4670-ab06-16c5d481b91d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f574670-2585-4670-ab06-16c5d481b91d', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Trying to clone 4f574670-2585-4670-ab06-16c5d481b91d from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:14:47 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Image download 20.69 MB at 20.69 MB/s Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[debab9a8-c883-42bd-8afc-dad103878c06]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:47 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD Jul 09 01:14:47 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:48 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:48 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 is fetched for user 750dc51486724daca5fecd779b77ec85. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:14:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053efaf-8dba-4f06-b269-6c203490b2ea]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:48 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD Jul 09 01:14:48 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-4e5d32eb-5ae4-4d6f-a6b8-67b5d3bb2c10 req-25c2a474-02b4-4bd9-993a-36e40cc2b656 tempest-AttachVolumeTestJSON-1231346191 None] Terminate volume connection completed successfully. Jul 09 01:14:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-4e5d32eb-5ae4-4d6f-a6b8-67b5d3bb2c10 req-25c2a474-02b4-4bd9-993a-36e40cc2b656 tempest-AttachVolumeTestJSON-1231346191 None] Deleting attachment 12f7ad13-1312-4037-bcc7-192cc0f880e7. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:14:49 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD" returned: 0 in 0.802s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-445448151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f574670-2585-4670-ab06-16c5d481b91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791a54b01e54bca9a2e6a3d883fdb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:14:46Z,use_quota=True,user_id='750dc51486724daca5fecd779b77ec85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Creating volume 4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:14:49 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:14:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:49 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1073741824 Jul 09 01:14:49 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:50 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1073741824" returned: 0 in 0.894s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:50 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:14:50 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:50 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 0.672s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:14:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:51 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Attempting download of 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 4f574670-2585-4670-ab06-16c5d481b91d. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:14:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3d98bf-1566-44cd-96ff-260da7bd8a95]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:51 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495 Jul 09 01:14:51 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:52 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495" returned: 0 in 0.972s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:52 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495 Jul 09 01:14:52 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-5810d1ec-078a-4e97-9a92-0e32479d9557-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-5810d1ec-078a-4e97-9a92-0e32479d9557-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-quobyte-5810d1ec-078a-4e97-9a92-0e32479d9557" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-5810d1ec-078a-4e97-9a92-0e32479d9557" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da321db-7717-43f4-89db-ab2b8d131ded]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:52 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495" returned: 1 in 0.946s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_sw6bq495' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc70bdce-d007-40ca-8152-440e7a38dc15]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:53 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 Jul 09 01:14:53 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:53 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD Jul 09 01:14:53 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:53 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD" returned: 0 in 0.888s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:53 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] 52f835e6-23a6-4938-9b95-f63e8048dcd3 was qcow2, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:14:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:53 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557" returned: 0 in 0.940s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:53 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:14:53 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:53 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557 Jul 09 01:14:53 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:54 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5810d1ec-078a-4e97-9a92-0e32479d9557" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-5810d1ec-078a-4e97-9a92-0e32479d9557" released by "delete_volume" :: held 1.752s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Created reservations ['06759d6a-32ef-40c5-9782-36921dcfdf0d', '9b368d74-7b95-4d69-a035-096fbccc11e1', 'db26a3d9-9a3a-4ff7-9e7e-2e0e9071c5fe', '991a7b42-1e06-4beb-b841-12146d463bbe'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:54 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:54 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-fa8c8736-e781-4d75-bbe8-726ef33e8954-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-fa8c8736-e781-4d75-bbe8-726ef33e8954-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-quobyte-fa8c8736-e781-4d75-bbe8-726ef33e8954" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-fa8c8736-e781-4d75-bbe8-726ef33e8954" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4442322-f0b8-4077-8b2a-6ac82a733110]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:55 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 Jul 09 01:14:55 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:55 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Deleted volume successfully. Jul 09 01:14:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0fbc5426-a978-4182-ae8e-dde7f5d4bd3a tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-5810d1ec-078a-4e97-9a92-0e32479d9557-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:56 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 2.443s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:56 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_s6h70em5devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:14:56 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Converted 112.00 MB image at 45.83 MB/s Jul 09 01:14:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:56 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1G Jul 09 01:14:56 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:56 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954" returned: 0 in 1.082s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:56 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954 Jul 09 01:14:56 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:57 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 1G" returned: 0 in 0.837s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b40e8-1460-43b9-8a37-39bad306c13a]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:57 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fa8c8736-e781-4d75-bbe8-726ef33e8954" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-fa8c8736-e781-4d75-bbe8-726ef33e8954" released by "delete_volume" :: held 1.910s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:57 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:14:57 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Created reservations ['cdcddac0-67cc-4535-bab6-d8df89f80913', '4972c4eb-4953-4bf9-8c4c-a42618c222c7', 'b18af25b-e980-4c3c-97db-6cc2cdec9345', '5a58e3f7-5f7f-4d17-b831-ce089f060d53'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:57 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:14:57 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-eeff733e-96a4-4f6d-9f8c-e888dcda09eb-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-eeff733e-96a4-4f6d-9f8c-e888dcda09eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "cinder-quobyte-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ebc3e-2c75-49e4-a136-d4f3c3abbdb9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:14:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:58 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb Jul 09 01:14:58 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:58 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 1.022s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:58 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:14:58 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:58 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.997s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:58 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:14:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Deleted volume successfully. Jul 09 01:14:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65d7c2ed-8be7-4442-a34e-227dea979a00 tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-fa8c8736-e781-4d75-bbe8-726ef33e8954-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:14:59 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" returned: 0 in 1.394s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:14:59 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb Jul 09 01:14:59 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:14:59 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 1 in 1.219s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Downloaded image 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 4f574670-2585-4670-ab06-16c5d481b91d successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 for user 750dc51486724daca5fecd779b77ec85 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Marking volume 4f574670-2585-4670-ab06-16c5d481b91d as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Copying metadata from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 to 4f574670-2585-4670-ab06-16c5d481b91d. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Creating volume glance metadata for volume 4f574670-2585-4670-ab06-16c5d481b91d backed by image 52f835e6-23a6-4938-9b95-f63e8048dcd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fa6cc1-93df-432f-ba4a-206478f43d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f574670-2585-4670-ab06-16c5d481b91d', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769cdb69-be09-4ec8-9e44-4bc7ed0989e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:14:59 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Volume volume-4f574670-2585-4670-ab06-16c5d481b91d (4f574670-2585-4670-ab06-16c5d481b91d): created successfully Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769cdb69-be09-4ec8-9e44-4bc7ed0989e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:14:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Flow 'volume_create_manager' (c69e6048-b57a-4f65-9b6e-0e90869cfccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:14:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-152a8602-9dd9-4cab-93b1-095f14c157c8 tempest-VolumesExtendTest-428182657 None] Created volume successfully. Jul 09 01:15:00 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" returned: 0 in 0.744s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-quobyte-eeff733e-96a4-4f6d-9f8c-e888dcda09eb" released by "delete_volume" :: held 2.189s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Created reservations ['ea3f5322-5d98-423a-8f0b-3b957244ddba', 'e8301e9a-d9e5-4c8a-9084-2795be7f91d3', '79fcb7e2-8d63-4404-bdfe-076e17e8826b', 'ccc56f25-f887-449e-aad9-c473ede5fa56'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:00 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:00 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f04110-ade6-4809-8daf-b22a76b6bf3b]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:00 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:15:00 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:01 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:01 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:01 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Deleted volume successfully. Jul 09 01:15:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f15a72e9-6789-4be2-b4b5-f98ea6ccd5ba tempest-AttachVolumeNegativeTest-1699498806 None] Lock "cinder-eeff733e-96a4-4f6d-9f8c-e888dcda09eb-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:01 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:01 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:15:01 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:02 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 1 in 1.445s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:15:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 2G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d 2G" returned: 0 in 0.103s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.514s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0cb8c217-e289-4716-9195-addc43c5be22 tempest-VolumesExtendTest-428182657 None] Extend volume completed successfully. Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-4f574670-2585-4670-ab06-16c5d481b91d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "cinder-4f574670-2585-4670-ab06-16c5d481b91d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=74,cinder:UPDATE=79,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=59,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=25 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-quobyte-4f574670-2585-4670-ab06-16c5d481b91d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-4f574670-2585-4670-ab06-16c5d481b91d" acquired by "delete_volume" :: waited 0.043s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[286753ff-8ec8-4317-bc62-cfc3b8286d78]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:04 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:15:04 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:05 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 1.221s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:05 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:15:05 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:06 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 1 in 1.208s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:15:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:06 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d Jul 09 01:15:06 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:07 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4f574670-2585-4670-ab06-16c5d481b91d" returned: 0 in 0.948s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-4f574670-2585-4670-ab06-16c5d481b91d" released by "delete_volume" :: held 3.464s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Created reservations ['4f63d812-9374-4b84-8326-18148f1619d8', '7c53d699-7b16-430c-8c91-305121d009b1', 'ac0c4b95-d2cc-4eed-97dd-7edb0f4dc50b', 'f54cd51d-571b-4d03-a9fa-3128f4aaf465'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:07 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:07 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:08 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.698s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:08 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Deleted volume successfully. Jul 09 01:15:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a9834d05-47c9-48ff-bea2-14870fc935be tempest-VolumesExtendTest-428182657 None] Lock "cinder-4f574670-2585-4670-ab06-16c5d481b91d-delete_volume" released by "delete_volume" :: held 4.499s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Flow 'volume_create_manager' (7d0aea4a-ad1b-43b8-97c4-51f9ccffc417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e63879f-f4a7-47ff-93b0-09905615f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e63879f-f4a7-47ff-93b0-09905615f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-686615621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364409d4-c1e7-4959-9ecc-7e553caba437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791a54b01e54bca9a2e6a3d883fdb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:09Z,use_quota=True,user_id='750dc51486724daca5fecd779b77ec85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb28fc-f1ea-4319-abbc-7b2cc4aba826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb28fc-f1ea-4319-abbc-7b2cc4aba826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00988b0-f922-43ec-8377-92fcc01ade62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00988b0-f922-43ec-8377-92fcc01ade62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364409d4-c1e7-4959-9ecc-7e553caba437', 'volume_name': 'volume-364409d4-c1e7-4959-9ecc-7e553caba437', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a17a85-83d7-43d0-a9eb-0e821658db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a17a85-83d7-43d0-a9eb-0e821658db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7cc770-7b73-4037-9b73-d9a68777c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Volume 364409d4-c1e7-4959-9ecc-7e553caba437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364409d4-c1e7-4959-9ecc-7e553caba437', 'volume_size': 1} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-686615621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364409d4-c1e7-4959-9ecc-7e553caba437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791a54b01e54bca9a2e6a3d883fdb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:09Z,use_quota=True,user_id='750dc51486724daca5fecd779b77ec85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Creating volume 364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:09 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:09 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 1073741824 Jul 09 01:15:09 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:10 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 1073741824" returned: 0 in 0.997s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:10 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:10 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:11 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 1.018s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7cc770-7b73-4037-9b73-d9a68777c724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364409d4-c1e7-4959-9ecc-7e553caba437', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca130fda-58dd-40d7-ab69-b97756114bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Volume volume-364409d4-c1e7-4959-9ecc-7e553caba437 (364409d4-c1e7-4959-9ecc-7e553caba437): created successfully Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca130fda-58dd-40d7-ab69-b97756114bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Flow 'volume_create_manager' (7d0aea4a-ad1b-43b8-97c4-51f9ccffc417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:11 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fc4b9d77-2738-4789-9efd-464e08e9f1f2 tempest-VolumesExtendTest-428182657 None] Created volume successfully. Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (46d1cd1a-2c1f-4f92-85ad-25aed80ca3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197c28d5-abd6-4f36-a473-367b1adaa2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197c28d5-abd6-4f36-a473-367b1adaa2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2090147687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555784f3-ccfa-40f7-a4a2-3ae0cb51f594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:12Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4256d8-af01-4e9d-9c80-dfde58890333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4256d8-af01-4e9d-9c80-dfde58890333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a812adb-4a0e-4677-8dd4-e08530f165ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a812adb-4a0e-4677-8dd4-e08530f165ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555784f3-ccfa-40f7-a4a2-3ae0cb51f594', 'volume_name': 'volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df9bc5f-6b0f-4173-81e9-246859ec11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df9bc5f-6b0f-4173-81e9-246859ec11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266b85c1-d736-471c-9e8a-f27be8879383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Volume 555784f3-ccfa-40f7-a4a2-3ae0cb51f594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594', 'volume_size': 1} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2090147687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555784f3-ccfa-40f7-a4a2-3ae0cb51f594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:12Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Creating volume 555784f3-ccfa-40f7-a4a2-3ae0cb51f594 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:11 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:11 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 1073741824 Jul 09 01:15:11 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:13 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 1073741824" returned: 0 in 1.137s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:13 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 Jul 09 01:15:13 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:13 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" returned: 0 in 0.792s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.499s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Creating offline snapshot 91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 of volume 364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266b85c1-d736-471c-9e8a-f27be8879383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73608e5c-84c0-4607-956e-951cb7c23a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c74319d-6877-4d28-9392-598c6d07b822]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Volume volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 (555784f3-ccfa-40f7-a4a2-3ae0cb51f594): created successfully Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73608e5c-84c0-4607-956e-951cb7c23a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (46d1cd1a-2c1f-4f92-85ad-25aed80ca3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-10b2501b-5343-4ced-ad46-90ed9acf2c75 tempest-VolumesTestJSON-1482711323 None] Created volume successfully. Jul 09 01:15:14 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:14 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:14 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:14 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 1G Jul 09 01:15:14 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (2cd28ae9-d0d1-40a7-858d-7e60653e73d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93327215-4cc2-4c4e-becd-00d15ba60995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93327215-4cc2-4c4e-becd-00d15ba60995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1833345393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8431a355-2855-427c-ac2d-b767e2cdf796,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:16Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87eb6a8-119b-4ee2-ba33-6e111126f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87eb6a8-119b-4ee2-ba33-6e111126f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a7c5c0-d875-4d59-a1a0-24a54a1265fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a7c5c0-d875-4d59-a1a0-24a54a1265fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8431a355-2855-427c-ac2d-b767e2cdf796', 'volume_name': 'volume-8431a355-2855-427c-ac2d-b767e2cdf796', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb620bd-41fb-4dd3-bf7a-870ebf1927e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb620bd-41fb-4dd3-bf7a-870ebf1927e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d237d3f6-3620-492a-abed-55e044c8dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:15 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Volume 8431a355-2855-427c-ac2d-b767e2cdf796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8431a355-2855-427c-ac2d-b767e2cdf796', 'volume_size': 1} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:15 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 1G" returned: 0 in 1.010s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364409d4-c1e7-4959-9ecc-7e553caba437 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:15 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364409d4-c1e7-4959-9ecc-7e553caba437 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 Jul 09 01:15:15 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:16 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364409d4-c1e7-4959-9ecc-7e553caba437 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" returned: 0 in 0.884s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:16 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 is being set with open permissions: ugo+rw Jul 09 01:15:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:16 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 Jul 09 01:15:16 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:17 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" returned: 0 in 0.774s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:17 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info Jul 09 01:15:17 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:18 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:18 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info is being set with open permissions: ugo+rw Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:18 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info Jul 09 01:15:18 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:18 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.info" returned: 0 in 0.643s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.026s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1833345393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8431a355-2855-427c-ac2d-b767e2cdf796,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:16Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Creating volume 8431a355-2855-427c-ac2d-b767e2cdf796 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:18 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:18 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 1073741824 Jul 09 01:15:18 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:18 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-362524d2-a4f3-4681-a8e2-d6cb49f558a4 tempest-VolumesExtendTest-428182657 None] Create snapshot completed successfully Jul 09 01:15:19 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 1073741824" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:19 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 Jul 09 01:15:19 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:20 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.504s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d237d3f6-3620-492a-abed-55e044c8dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8431a355-2855-427c-ac2d-b767e2cdf796', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac92969b-c48a-4919-8187-fac0e0a13bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2fbee5-494c-4091-a249-ccabe52a2afe]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Volume volume-8431a355-2855-427c-ac2d-b767e2cdf796 (8431a355-2855-427c-ac2d-b767e2cdf796): created successfully Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac92969b-c48a-4919-8187-fac0e0a13bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (2cd28ae9-d0d1-40a7-858d-7e60653e73d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-70709713-01ac-4bf9-b2f4-976769760bf6 tempest-VolumesTestJSON-1482711323 None] Created volume successfully. Jul 09 01:15:20 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:20 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:21 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 0.968s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 2G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 2G" returned: 0 in 0.269s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.304s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (33bf2270-37e7-4763-bbd7-a17c6e55c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92d32df-7312-47a7-a035-d21a4677fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92d32df-7312-47a7-a035-d21a4677fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-760176314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44698c1-377d-4d0f-a5e0-b0d2aae927be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:22Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb70801-8e15-4029-a2d2-8d70b87fed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb70801-8e15-4029-a2d2-8d70b87fed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6a5245-6357-4926-b71c-4a9b9f970ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6a5245-6357-4926-b71c-4a9b9f970ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44698c1-377d-4d0f-a5e0-b0d2aae927be', 'volume_name': 'volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90aa57e8-df01-40a6-ab1d-2fdf8bc23fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90aa57e8-df01-40a6-ab1d-2fdf8bc23fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31254be9-7963-4a1d-bc51-b3c354f26853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Volume f44698c1-377d-4d0f-a5e0-b0d2aae927be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be', 'volume_size': 1} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-760176314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44698c1-377d-4d0f-a5e0-b0d2aae927be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4c625f40a4b819f3aaa1220dedc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:22Z,use_quota=True,user_id='d4d3ecf889274cfb9c1135d69eea63b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Creating volume f44698c1-377d-4d0f-a5e0-b0d2aae927be {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:21 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8138c080-19f2-4c5d-a4f7-5a6d1e7c5a7c tempest-VolumesExtendTest-428182657 None] Extend volume completed successfully. Jul 09 01:15:21 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be 1073741824 Jul 09 01:15:21 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-quobyte-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Deleting offline snapshot 91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 of volume 364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] snapshot_file for this snap is: volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8482ce-e7b5-4e01-8cb0-1f1b739cf20d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:22 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 Jul 09 01:15:22 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:23 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be 1073741824" returned: 0 in 1.172s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:23 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be Jul 09 01:15:23 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:23 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" returned: 0 in 1.285s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364409d4-c1e7-4959-9ecc-7e553caba437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a30eef-24e0-4408-bc73-94aade107a3b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:24 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be" returned: 0 in 1.157s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31254be9-7963-4a1d-bc51-b3c354f26853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7e3b6-6967-42a6-bda6-4456f3177f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:24 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Volume volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be (f44698c1-377d-4d0f-a5e0-b0d2aae927be): created successfully Jul 09 01:15:24 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7e3b6-6967-42a6-bda6-4456f3177f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Flow 'volume_create_manager' (33bf2270-37e7-4763-bbd7-a17c6e55c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-926494e9-a90a-4e74-8065-63d2a3fd0179 tempest-VolumesTestJSON-1482711323 None] Created volume successfully. Jul 09 01:15:25 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:25 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 Jul 09 01:15:25 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-f44698c1-377d-4d0f-a5e0-b0d2aae927be-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-f44698c1-377d-4d0f-a5e0-b0d2aae927be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-quobyte-f44698c1-377d-4d0f-a5e0-b0d2aae927be" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:25 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" returned: 0 in 0.888s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-f44698c1-377d-4d0f-a5e0-b0d2aae927be" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:25 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08 Jul 09 01:15:25 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a9bc2-fdea-4cdb-8bad-57d31a759376]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:26 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be Jul 09 01:15:26 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:26 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437.91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" returned: 0 in 0.805s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08" released by "_delete_snapshot" :: held 4.283s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" released by "delete_snapshot" :: held 4.314s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:26 devstack cinder-volume[86954]: WARNING cinder.quota [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Created reservations ['dcf71ee5-68f1-4a2d-bc38-2db2e7fc15c0', 'eced407a-e720-4cfa-9df9-da81de24b7f2', '4e399a23-f8be-44d4-9125-1844c7df21c7', '58d0a05c-e149-4c5e-919e-263c8f4b23e3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:26 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be" returned: 0 in 0.997s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Delete snapshot completed successfully. Jul 09 01:15:26 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be Jul 09 01:15:26 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfab9df7-1d60-4d5f-8747-9cfd32a8ac13 tempest-VolumesExtendTest-428182657 None] Lock "cinder-91e9b2fa-eb97-4dcb-b1a9-7af98f22ef08-delete_snapshot" released by "delete_snapshot" :: held 4.530s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:27 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f44698c1-377d-4d0f-a5e0-b0d2aae927be" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-f44698c1-377d-4d0f-a5e0-b0d2aae927be" released by "delete_volume" :: held 1.698s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Created reservations ['0b8a8e8d-1285-47cf-8996-d8798eafe742', '5ed40d35-0d57-44fb-b244-34ae4f91a904', 'c1e49ec0-ca1b-49b7-be50-3c4ffc87c65e', '40e48811-dd79-4724-b695-f4c2312679e2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:27 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:27 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-364409d4-c1e7-4959-9ecc-7e553caba437-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "cinder-364409d4-c1e7-4959-9ecc-7e553caba437-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Acquiring lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b81a95-f967-4b7f-84ed-6e05d415ddb1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-8431a355-2855-427c-ac2d-b767e2cdf796-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "cinder-8431a355-2855-427c-ac2d-b767e2cdf796-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-quobyte-8431a355-2855-427c-ac2d-b767e2cdf796" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-8431a355-2855-427c-ac2d-b767e2cdf796" acquired by "delete_volume" :: waited 0.046s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64a6af-6027-4031-a7a9-98720b2691b6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:28 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:28 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:28 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 Jul 09 01:15:28 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:28 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.137s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Deleted volume successfully. Jul 09 01:15:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c238b14f-7e0b-4a7b-842a-f9f48a5c4dd5 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-f44698c1-377d-4d0f-a5e0-b0d2aae927be-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:29 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 1.333s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:29 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437 Jul 09 01:15:29 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:29 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796" returned: 0 in 1.560s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:29 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796 Jul 09 01:15:29 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:30 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-364409d4-c1e7-4959-9ecc-7e553caba437" returned: 0 in 1.149s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "cinder-quobyte-364409d4-c1e7-4959-9ecc-7e553caba437" released by "delete_volume" :: held 2.554s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Created reservations ['62a4f94f-3274-488a-b059-37f6790bcb6c', '43148c7f-6008-43e6-b75d-baeac6c8da24', '734c3b51-fd0d-437e-8cae-5bb0631de33f', '38d0735b-632f-4124-8cdc-d4d2a8bcf575'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:30 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8431a355-2855-427c-ac2d-b767e2cdf796" returned: 0 in 0.940s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-8431a355-2855-427c-ac2d-b767e2cdf796" released by "delete_volume" :: held 2.561s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:30 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:30 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Created reservations ['6ba444e8-d42e-41ec-a86a-c940a19c8739', 'f91e9ee6-bd6e-4cdd-8d16-38496bdbd687', 'a2e30dcd-0e80-49c2-805a-8988c6fdaeb8', '26e7fc2b-5a7b-4dcd-b357-d6c2093f39d9'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:30 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:30 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-555784f3-ccfa-40f7-a4a2-3ae0cb51f594-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:31 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.875s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-555784f3-ccfa-40f7-a4a2-3ae0cb51f594-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Deleted volume successfully. Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e0226219-1f91-49cf-8d3e-105e0e9a5eb5 tempest-VolumesExtendTest-428182657 None] Lock "cinder-364409d4-c1e7-4959-9ecc-7e553caba437-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "cinder-quobyte-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b9642-6ec9-4d0c-9602-6c560aa5dc0e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:32 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 Jul 09 01:15:32 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:32 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.102s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:32 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Deleted volume successfully. Jul 09 01:15:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2965b778-2f5e-43da-9816-35ea2590e0bf tempest-VolumesTestJSON-1482711323 None] Lock "cinder-8431a355-2855-427c-ac2d-b767e2cdf796-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:32 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" returned: 0 in 0.827s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:32 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594 Jul 09 01:15:32 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:33 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-quobyte-555784f3-ccfa-40f7-a4a2-3ae0cb51f594" released by "delete_volume" :: held 1.589s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Created reservations ['7ce22db9-76e6-4019-8bfb-dad237699a92', 'cee8de66-e5db-4da8-ad33-62716577a060', '9c19e478-5b58-409b-91e5-180ce35d710d', '4f9de9ad-fd1c-42f2-9231-3996e350fc2c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:33 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:33 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:33 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:15:33 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:34 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:34 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Deleted volume successfully. Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-441efb14-2400-4127-8805-e8535e3d9ea6 tempest-VolumesTestJSON-1482711323 None] Lock "cinder-555784f3-ccfa-40f7-a4a2-3ae0cb51f594-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:15:34 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:15:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:15:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e06b3b7f-5510-4cf9-88b3-58566e7b2dcf tempest-GroupSnapshotsV319Test-1239470114 None] Group tempest-GroupSnapshotsV319Test-Group-1216790284: creating Jul 09 01:15:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e06b3b7f-5510-4cf9-88b3-58566e7b2dcf tempest-GroupSnapshotsV319Test-1239470114 None] Group tempest-GroupSnapshotsV319Test-Group-1216790284: created successfully Jul 09 01:15:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e06b3b7f-5510-4cf9-88b3-58566e7b2dcf tempest-GroupSnapshotsV319Test-1239470114 None] Create group completed successfully. Jul 09 01:15:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (31e7fc5d-e1d9-481b-a129-a0debdb318b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125bf1e-58ad-4542-8100-cedfa5da3f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125bf1e-58ad-4542-8100-cedfa5da3f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152228387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465c8fc5-47aa-4fa1-81d8-403804e19fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:39Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28317933-3139-493f-a0b1-53ba91d285f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28317933-3139-493f-a0b1-53ba91d285f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ece292-05db-465d-a1d3-e24314a99392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ece292-05db-465d-a1d3-e24314a99392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465c8fc5-47aa-4fa1-81d8-403804e19fa5', 'volume_name': 'volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e5edcd-bd8e-4dab-a8b2-3a083348c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e5edcd-bd8e-4dab-a8b2-3a083348c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227faf75-26a0-49d4-9e4a-a8fb6b09a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume 465c8fc5-47aa-4fa1-81d8-403804e19fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5', 'volume_size': 1} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152228387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465c8fc5-47aa-4fa1-81d8-403804e19fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:39Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume 465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:39 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:39 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 1073741824 Jul 09 01:15:39 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:40 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 1073741824" returned: 0 in 1.049s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:40 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 Jul 09 01:15:40 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Flow 'volume_create_manager' (b80ff19d-ee41-42cf-aed6-f49de6083dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a54bee-a1ba-49bb-90c9-a815427429fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a54bee-a1ba-49bb-90c9-a815427429fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199043915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97546cd1-89c6-435e-bc4e-e05ad7ea2802,host='devstack@QuobyteHD#QuobyteHD',id=08b70536-e685-4791-a7b7-41118e908294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0b047eb9434bee9493e1746ebf11e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:40Z,use_quota=True,user_id='395622041fdf49d4bf8e7e5cd564dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a46fc593-67e1-4886-b89f-3dcb59351c09),volume_type_id=a46fc593-67e1-4886-b89f-3dcb59351c09)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b9cf1d-ad2d-4c3c-8179-e5f80946f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b9cf1d-ad2d-4c3c-8179-e5f80946f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d449bd-5a0b-408d-b203-61bb4fce13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d449bd-5a0b-408d-b203-61bb4fce13fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b70536-e685-4791-a7b7-41118e908294', 'volume_name': 'volume-08b70536-e685-4791-a7b7-41118e908294', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23da19fa-3429-4da1-b954-d9dc1c0da8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23da19fa-3429-4da1-b954-d9dc1c0da8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0f267b-ddf3-44aa-bd20-5ee9cee5aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Volume 08b70536-e685-4791-a7b7-41118e908294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b70536-e685-4791-a7b7-41118e908294', 'volume_size': 1} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:40 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5" returned: 0 in 0.773s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97546cd1-89c6-435e-bc4e-e05ad7ea2802,created_at=2026-07-08T23:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199043915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97546cd1-89c6-435e-bc4e-e05ad7ea2802,host='devstack@QuobyteHD#QuobyteHD',id=08b70536-e685-4791-a7b7-41118e908294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0b047eb9434bee9493e1746ebf11e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:40Z,use_quota=True,user_id='395622041fdf49d4bf8e7e5cd564dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a46fc593-67e1-4886-b89f-3dcb59351c09),volume_type_id=a46fc593-67e1-4886-b89f-3dcb59351c09)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Creating volume 08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:40 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:40 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 1073741824 Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227faf75-26a0-49d4-9e4a-a8fb6b09a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:40 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6de2fc0-23b0-4ba3-a3fa-85582b42f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 (465c8fc5-47aa-4fa1-81d8-403804e19fa5): created successfully Jul 09 01:15:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6de2fc0-23b0-4ba3-a3fa-85582b42f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (31e7fc5d-e1d9-481b-a129-a0debdb318b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-85c3945b-4204-4efc-8285-b43c2d4b703e tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:15:41 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 1073741824" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:41 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 Jul 09 01:15:41 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:42 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294" returned: 0 in 0.663s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.199s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating offline snapshot 06765a11-2dcc-4b62-ad19-cff8a8815231 of volume 465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0f267b-ddf3-44aa-bd20-5ee9cee5aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b70536-e685-4791-a7b7-41118e908294', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab33038-a315-4995-b6cd-5372cdc8ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Volume volume-08b70536-e685-4791-a7b7-41118e908294 (08b70536-e685-4791-a7b7-41118e908294): created successfully Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab33038-a315-4995-b6cd-5372cdc8ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Flow 'volume_create_manager' (b80ff19d-ee41-42cf-aed6-f49de6083dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d496e2-b7b7-44bc-b041-ed6708b87fcc]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1e8bb658-2188-407f-8469-8388979c8638 tempest-GroupSnapshotsV319Test-1239470114 None] Created volume successfully. Jul 09 01:15:42 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 Jul 09 01:15:42 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Flow 'volume_create_manager' (1faddc79-2e1f-4e2a-9bbb-1c9cd0a6900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59c9ed9-9dc4-4014-b065-7bce1e6c715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] GroupSnapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: creating. Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59c9ed9-9dc4-4014-b065-7bce1e6c715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1909507935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a349a-a407-4831-b441-2267407c4c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76e7a295fa64d1b9bbaf6ecbbacf7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:43Z,use_quota=True,user_id='e50a00d0500444b287c7fd3b8950a3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f4113-e093-49ee-9825-57562a30fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f4113-e093-49ee-9825-57562a30fc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925fa0b-4456-43f6-976c-300ea8ded5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925fa0b-4456-43f6-976c-300ea8ded5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29a349a-a407-4831-b441-2267407c4c33', 'volume_name': 'volume-d29a349a-a407-4831-b441-2267407c4c33', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af80c275-91c9-46ba-80cf-acda089d827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af80c275-91c9-46ba-80cf-acda089d827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a1c36e-ae57-440f-b84b-316dca09c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Volume d29a349a-a407-4831-b441-2267407c4c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29a349a-a407-4831-b441-2267407c4c33', 'volume_size': 1} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Group snapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: creating. {{(pid=86954) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:43 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5" returned: 0 in 0.925s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:43 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 1G Jul 09 01:15:43 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:44 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 1G" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:44 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 Jul 09 01:15:44 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:45 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:45 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 is being set with open permissions: ugo+rw Jul 09 01:15:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:45 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 Jul 09 01:15:45 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:45 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231" returned: 0 in 0.825s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:46 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info Jul 09 01:15:46 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:46 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info" returned: 0 in 0.733s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:46 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info is being set with open permissions: ugo+rw Jul 09 01:15:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:46 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info Jul 09 01:15:46 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:47 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.info" returned: 0 in 0.648s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.838s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1909507935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a349a-a407-4831-b441-2267407c4c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76e7a295fa64d1b9bbaf6ecbbacf7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:43Z,use_quota=True,user_id='e50a00d0500444b287c7fd3b8950a3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Creating volume d29a349a-a407-4831-b441-2267407c4c33 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:47 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:47 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 1073741824 Jul 09 01:15:47 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-35af01a5-f46c-46e5-b540-907cd74b1fac tempest-CreateVolumesFromSnapshotTest-1185952585 None] Create snapshot completed successfully Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (812a5e99-4443-4fb5-8e7a-2abac4a1d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3288f-a9a5-48b8-9a9b-6a4c164c0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3288f-a9a5-48b8-9a9b-6a4c164c0761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203373009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31f1232-ac95-4203-bab6-2854d45d97be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:48Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fce48c-9d7c-4978-b639-b2346aed0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fce48c-9d7c-4978-b639-b2346aed0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bbf0a-10dd-4254-abff-a134c8b72768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bbf0a-10dd-4254-abff-a134c8b72768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31f1232-ac95-4203-bab6-2854d45d97be', 'volume_name': 'volume-d31f1232-ac95-4203-bab6-2854d45d97be', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e915d555-58a6-4bb6-b9f1-85c630bbc989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e915d555-58a6-4bb6-b9f1-85c630bbc989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fa4ad1-af1a-4cbd-a843-8ab31e26fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume d31f1232-ac95-4203-bab6-2854d45d97be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31f1232-ac95-4203-bab6-2854d45d97be', 'volume_size': 1} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:48 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 1073741824" returned: 0 in 0.980s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:48 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 Jul 09 01:15:48 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (c970bd63-82b4-45eb-bb97-92424a7559a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347c3e6a-8c1e-46ee-aa86-0926ca362e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347c3e6a-8c1e-46ee-aa86-0926ca362e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832994173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59919de5-3422-4f41-8276-a1be0d7bc85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:48Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0a7936-4f30-40fd-8133-94dd11b45638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0a7936-4f30-40fd-8133-94dd11b45638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e790984-739c-416d-86fa-49a5b51e66b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e790984-739c-416d-86fa-49a5b51e66b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59919de5-3422-4f41-8276-a1be0d7bc85e', 'volume_name': 'volume-59919de5-3422-4f41-8276-a1be0d7bc85e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ffcc5f-9785-41e7-91f8-23ee849a442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ffcc5f-9785-41e7-91f8-23ee849a442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d255a05-2539-44d8-8f38-12ca4cf10ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume 59919de5-3422-4f41-8276-a1be0d7bc85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59919de5-3422-4f41-8276-a1be0d7bc85e', 'volume_size': 1} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (35566a39-7cf1-4559-8352-c06e03ad53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c31b74-579c-4ab7-9a14-bdde471c6872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c31b74-579c-4ab7-9a14-bdde471c6872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858172287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45397e-a732-4baf-a32b-f930bfff7fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:49Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bd218a-5fb4-4864-b5d2-94ce451a51cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bd218a-5fb4-4864-b5d2-94ce451a51cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9985e54e-d7a8-4b0a-b389-8da3803c0694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9985e54e-d7a8-4b0a-b389-8da3803c0694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd45397e-a732-4baf-a32b-f930bfff7fe7', 'volume_name': 'volume-bd45397e-a732-4baf-a32b-f930bfff7fe7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2caaeb-93f8-421c-b237-287a9aba943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2caaeb-93f8-421c-b237-287a9aba943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c529ff41-a498-47f2-b70c-5665c5824811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume bd45397e-a732-4baf-a32b-f930bfff7fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd45397e-a732-4baf-a32b-f930bfff7fe7', 'volume_size': 1} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:49 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33" returned: 0 in 0.787s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.794s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Creating offline snapshot db84ae77-cb99-47a6-89a0-1755a9e17771 of volume 08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a1c36e-ae57-440f-b84b-316dca09c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29a349a-a407-4831-b441-2267407c4c33', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b89a253-f7b6-4848-b099-418d5901ff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ddac0c-e40b-4285-936a-7317be40afaf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Volume volume-d29a349a-a407-4831-b441-2267407c4c33 (d29a349a-a407-4831-b441-2267407c4c33): created successfully Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b89a253-f7b6-4848-b099-418d5901ff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Flow 'volume_create_manager' (1faddc79-2e1f-4e2a-9bbb-1c9cd0a6900d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f08b0c0c-a787-454a-926f-9599fef07eec tempest-AttachVolumeShelveTestJSON-488298608 None] Created volume successfully. Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (a8e409f5-0ff4-472d-a439-65a22af7788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ba0d86-824e-434f-acbd-2e7689be29f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ba0d86-824e-434f-acbd-2e7689be29f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451846252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ba6f6d-4e52-4b6b-8afc-0f10b548838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:49Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f90096-44c9-4728-b933-85129c6cb010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f90096-44c9-4728-b933-85129c6cb010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 Jul 09 01:15:49 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c32541-bfa4-47e7-a5ec-5ee203767d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c32541-bfa4-47e7-a5ec-5ee203767d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ba6f6d-4e52-4b6b-8afc-0f10b548838d', 'volume_name': 'volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7fd588-fd9a-4e4a-97cd-e8af201e1da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7fd588-fd9a-4e4a-97cd-e8af201e1da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333231cf-8195-46a7-9283-87adcd479e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume a5ba6f6d-4e52-4b6b-8afc-0f10b548838d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d', 'volume_size': 1} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (da9e4e84-4548-4319-8277-358939ce673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc014876-93a8-440b-9046-c1cc0e0ef9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc014876-93a8-440b-9046-c1cc0e0ef9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692977878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083fbf97-ac00-4c3f-8626-a8fe7e1c9994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:50Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5503a59f-c6e5-4e32-991f-22b2627318e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5503a59f-c6e5-4e32-991f-22b2627318e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517d9add-6156-4f90-af96-4ac3791d2bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517d9add-6156-4f90-af96-4ac3791d2bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083fbf97-ac00-4c3f-8626-a8fe7e1c9994', 'volume_name': 'volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458736a0-5c22-4538-8e92-73dd8e34fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458736a0-5c22-4538-8e92-73dd8e34fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f20e53-8019-4caa-aadb-6deb447bcba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume 083fbf97-ac00-4c3f-8626-a8fe7e1c9994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994', 'volume_size': 1} Jul 09 01:15:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:50 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294" returned: 0 in 1.182s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:50 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 1G Jul 09 01:15:50 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:51 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 1G" returned: 0 in 1.057s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b70536-e685-4791-a7b7-41118e908294 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:51 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b70536-e685-4791-a7b7-41118e908294 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 Jul 09 01:15:51 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:52 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b70536-e685-4791-a7b7-41118e908294 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771" returned: 0 in 0.749s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:52 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:15:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:52 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 Jul 09 01:15:52 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:52 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:53 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info Jul 09 01:15:53 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:53 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info" returned: 0 in 0.812s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:53 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:15:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:53 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info Jul 09 01:15:53 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:54 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.info" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.345s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.325s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203373009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31f1232-ac95-4203-bab6-2854d45d97be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:48Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume d31f1232-ac95-4203-bab6-2854d45d97be {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:54 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:54 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be 1073741824 Jul 09 01:15:54 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-968a53e8-2212-43da-b507-8c2637987663 tempest-GroupSnapshotsV319Test-1239470114 None] group_snapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: created successfully Jul 09 01:15:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] group_snapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: deleting Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] group_snapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: deleting {{(pid=86954) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "cinder-quobyte-db84ae77-cb99-47a6-89a0-1755a9e17771" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-db84ae77-cb99-47a6-89a0-1755a9e17771" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Deleting offline snapshot db84ae77-cb99-47a6-89a0-1755a9e17771 of volume 08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] snapshot_file for this snap is: volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc05e713-3de9-4c6b-991f-ebd2c8006666]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:56 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 Jul 09 01:15:56 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:56 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be 1073741824" returned: 0 in 1.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:56 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be Jul 09 01:15:56 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:57 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771" returned: 0 in 1.230s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08b70536-e685-4791-a7b7-41118e908294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c2ef7-92ba-4643-b15d-6367fa75c2c5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:57 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 Jul 09 01:15:57 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:57 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be" returned: 0 in 1.152s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (2899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.905s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.854s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832994173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59919de5-3422-4f41-8276-a1be0d7bc85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:48Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume 59919de5-3422-4f41-8276-a1be0d7bc85e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:15:57 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fa4ad1-af1a-4cbd-a843-8ab31e26fa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31f1232-ac95-4203-bab6-2854d45d97be', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5412673-29e0-4cab-8e77-df9df8d2c1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:15:57 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e 1073741824 Jul 09 01:15:57 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:57 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-d31f1232-ac95-4203-bab6-2854d45d97be (d31f1232-ac95-4203-bab6-2854d45d97be): created successfully Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5412673-29e0-4cab-8e77-df9df8d2c1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:15:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (812a5e99-4443-4fb5-8e7a-2abac4a1d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:15:57 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9414d938-9da9-4210-ab8e-a2c8cd69c20d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:15:58 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294" returned: 0 in 1.227s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:58 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 Jul 09 01:15:58 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:58 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e 1073741824" returned: 0 in 1.351s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:58 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e Jul 09 01:15:58 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:59 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771" returned: 0 in 1.063s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:15:59 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771 Jul 09 01:15:59 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:15:59 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 09 01:15:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e" returned: 0 in 1.097s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:15:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:15:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.966s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1858172287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45397e-a732-4baf-a32b-f930bfff7fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:49Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume bd45397e-a732-4baf-a32b-f930bfff7fe7 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:00 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d255a05-2539-44d8-8f38-12ca4cf10ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59919de5-3422-4f41-8276-a1be0d7bc85e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:00 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 1073741824 Jul 09 01:16:00 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe0efc-beec-4562-83c3-6ff1e0d153a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:00 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-59919de5-3422-4f41-8276-a1be0d7bc85e (59919de5-3422-4f41-8276-a1be0d7bc85e): created successfully Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe0efc-beec-4562-83c3-6ff1e0d153a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (c970bd63-82b4-45eb-bb97-92424a7559a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fa31968a-74c6-4254-8566-c545c1e7bfbe tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:16:00 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294.db84ae77-cb99-47a6-89a0-1755a9e17771" returned: 0 in 1.023s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-db84ae77-cb99-47a6-89a0-1755a9e17771" released by "_delete_snapshot" :: held 4.672s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" released by "delete_snapshot" :: held 4.704s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:00 devstack cinder-volume[86954]: WARNING cinder.quota [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-556813123 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-556813123, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:16:00 devstack cinder-volume[86954]: WARNING cinder.quota [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-556813123 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-556813123, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:16:00 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] Created reservations ['cbe31212-5d5e-44f2-8809-82d4243047c9', '1704dad4-0be4-4c6f-8a8b-4bc58d772a89', '08110b13-13f7-4d09-8c20-09a7932f3d7c', '6e92c450-8abe-4bf1-9c7a-c611d47f5ac1'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7de83f0d-fe86-4355-b5c3-f7cfb9b74bfd tempest-GroupSnapshotsV319Test-1239470114 None] group_snapshot 3e5fe64e-819a-4bd7-b293-ed34a4f09055: deleted successfully Jul 09 01:16:01 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 1073741824" returned: 0 in 1.199s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:01 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 Jul 09 01:16:01 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f7388-eb6d-4151-91e5-88a0fd1b4b57]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:02 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.544s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451846252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ba6f6d-4e52-4b6b-8afc-0f10b548838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:49Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume a5ba6f6d-4e52-4b6b-8afc-0f10b548838d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:02 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:02 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 Jul 09 01:16:02 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c529ff41-a498-47f2-b70c-5665c5824811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd45397e-a732-4baf-a32b-f930bfff7fe7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:02 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d 1073741824 Jul 09 01:16:02 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204b9179-3257-46dc-b539-f72ac0b51009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:02 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 (bd45397e-a732-4baf-a32b-f930bfff7fe7): created successfully Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204b9179-3257-46dc-b539-f72ac0b51009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (35566a39-7cf1-4559-8352-c06e03ad53ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1b707516-1ccc-45af-8888-a22104668975 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:16:02 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294" returned: 0 in 1.003s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:02 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294 Jul 09 01:16:02 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:03 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d 1073741824" returned: 0 in 1.195s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:03 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d Jul 09 01:16:03 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:03 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-08b70536-e685-4791-a7b7-41118e908294" returned: 0 in 0.843s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "cinder-quobyte-08b70536-e685-4791-a7b7-41118e908294" released by "delete_volume" :: held 1.926s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:03 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Created reservations ['b1914792-0fc8-4b8a-9952-aff07bd9e69b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:03 devstack cinder-volume[86954]: WARNING cinder.quota [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-556813123 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-556813123, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Created reservations ['843219c6-b1fd-4a80-b3a5-ed2673cff284', 'c68bfda3-4a74-458b-93ca-0cc8103173f2', '2b50b352-74a8-4465-8ed6-3e2b56f687df', 'f68198ea-26ad-4e64-abb1-00f8624d3aa6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:04 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.077s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692977878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083fbf97-ac00-4c3f-8626-a8fe7e1c9994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970002bc90b44743ac3e2d989ba8d24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:15:50Z,use_quota=True,user_id='43345d34a80344f98d735bed2140df3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Creating volume 083fbf97-ac00-4c3f-8626-a8fe7e1c9994 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:04 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:04 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 1073741824 Jul 09 01:16:04 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333231cf-8195-46a7-9283-87adcd479e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6942650-4f55-40b6-b909-05d8fbd684ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d (a5ba6f6d-4e52-4b6b-8afc-0f10b548838d): created successfully Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6942650-4f55-40b6-b909-05d8fbd684ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (a8e409f5-0ff4-472d-a439-65a22af7788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:16:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9ac736e7-cce4-4cbd-abcf-da535a53ee77 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:04 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:04 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:05 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 1073741824" returned: 0 in 1.311s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:05 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=79,cinder:INSERT=16,cinder:UPDATE=100,cinder:DELETE=12 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:16:05 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.121s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:05 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:05 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-315b1192-4f1a-40e4-afa0-8ae23a9c6635 tempest-GroupSnapshotsV319Test-1239470114 None] Delete group completed successfully. Jul 09 01:16:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:05 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 Jul 09 01:16:05 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:06 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" returned: 0 in 0.822s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f20e53-8019-4caa-aadb-6deb447bcba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa6cb6-ec5d-4c8e-bcc9-eb07b6ba0bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Volume volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 (083fbf97-ac00-4c3f-8626-a8fe7e1c9994): created successfully Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa6cb6-ec5d-4c8e-bcc9-eb07b6ba0bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Flow 'volume_create_manager' (da9e4e84-4548-4319-8277-358939ce673b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c2a308b6-a2ce-472f-9ea8-8d0b3464cc16 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created volume successfully. Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-083fbf97-ac00-4c3f-8626-a8fe7e1c9994-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-083fbf97-ac00-4c3f-8626-a8fe7e1c9994-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c078dab6-deee-4fdc-98df-0aa57aeb3f64]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:06 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 Jul 09 01:16:06 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:07 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" returned: 0 in 0.966s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:07 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994 Jul 09 01:16:07 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5de68ebb-c03a-44a7-8cac-e8144a767ed3 req-63b4e22e-e21b-48a4-b8e2-c53c806b7a5e tempest-AttachVolumeShelveTestJSON-488298608 None] No connector for attachment ed41c261-bafc-4b66-b328-385c4010da52; skipping storage backend terminate_connection call. {{(pid=86954) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5de68ebb-c03a-44a7-8cac-e8144a767ed3 req-63b4e22e-e21b-48a4-b8e2-c53c806b7a5e tempest-AttachVolumeShelveTestJSON-488298608 None] Deleting attachment ed41c261-bafc-4b66-b328-385c4010da52. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:16:08 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" returned: 0 in 0.751s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-083fbf97-ac00-4c3f-8626-a8fe7e1c9994" released by "delete_volume" :: held 1.767s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['06dcb4a3-85e7-4079-b1b1-5a6da37c152c', '0dd58767-f2ee-4f19-a838-eaafb481c56d', 'e5a92a26-3eef-4d59-ba08-85a6639b4a3f', '04caf9e1-54e2-40f5-b1f5-7e65ea17a797'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:08 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:08 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a3ea1a-b9f5-4481-900a-c9adb819d8fb]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:09 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d Jul 09 01:16:09 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:09 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.782s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1849871b-78ed-42b2-8da8-48ba517eb60f tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-083fbf97-ac00-4c3f-8626-a8fe7e1c9994-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:10 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" returned: 0 in 0.912s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:10 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d Jul 09 01:16:10 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:10 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" returned: 0 in 0.813s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d" released by "delete_volume" :: held 1.781s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:10 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['db1aa774-7859-45ce-ba66-e53ddf7efc13', '7137f673-1293-4c05-9ac3-4d54320e7734', 'c3117a56-5762-4f4e-abee-3227eafeb8c0', 'e086e39b-9be2-43c6-b402-d46a996a8426'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:11 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:11 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-bd45397e-a732-4baf-a32b-f930bfff7fe7-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-bd45397e-a732-4baf-a32b-f930bfff7fe7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-bd45397e-a732-4baf-a32b-f930bfff7fe7" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-bd45397e-a732-4baf-a32b-f930bfff7fe7" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f03e75-9e2a-4f64-bcdc-3dbe053e12d3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:11 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 Jul 09 01:16:11 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:11 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:11 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:11 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8c35703b-f2c0-4a9d-bee9-85f69f7a82fa tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-a5ba6f6d-4e52-4b6b-8afc-0f10b548838d-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:12 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7" returned: 0 in 0.992s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:12 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7 Jul 09 01:16:12 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:13 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bd45397e-a732-4baf-a32b-f930bfff7fe7" returned: 0 in 0.791s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-bd45397e-a732-4baf-a32b-f930bfff7fe7" released by "delete_volume" :: held 1.852s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['9b0e6be9-befd-40cb-a23e-b845b2d8435e', '67e1335a-9e2a-44aa-91c5-96e5a31a4003', '5161cc40-d393-4f75-9090-ddb4e52c402b', 'c44bfd56-1b57-4e00-a070-b74cf75e6f1d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:13 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:13 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-59919de5-3422-4f41-8276-a1be0d7bc85e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-59919de5-3422-4f41-8276-a1be0d7bc85e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-59919de5-3422-4f41-8276-a1be0d7bc85e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-59919de5-3422-4f41-8276-a1be0d7bc85e" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd59df-6e5b-4a3a-8ab0-63d3d99e5173]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:14 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e Jul 09 01:16:14 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:14 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:14 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-79b227b5-0d34-48fc-a321-b51aaf71c7d6 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-bd45397e-a732-4baf-a32b-f930bfff7fe7-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:14 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:14 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e Jul 09 01:16:14 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:15 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59919de5-3422-4f41-8276-a1be0d7bc85e" returned: 0 in 0.666s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-59919de5-3422-4f41-8276-a1be0d7bc85e" released by "delete_volume" :: held 1.536s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['81147037-e0a5-4d9c-b782-ca25a956e935', '6b83c9fc-e2d1-4439-a801-989aff12196b', '744870c3-446b-4306-b48b-1671d114c41e', '15a391d4-61ae-41aa-814a-4493dd56341f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:15 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:15 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-d31f1232-ac95-4203-bab6-2854d45d97be-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-d31f1232-ac95-4203-bab6-2854d45d97be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-d31f1232-ac95-4203-bab6-2854d45d97be" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-d31f1232-ac95-4203-bab6-2854d45d97be" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cb64d-4d86-4a7a-aa32-27c6bd27eb86]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f457064e-dd89-4788-be38-7e96e446dcf2 tempest-GroupsV314Test-543901242 None] Group tempest-GroupsV314Test-Group-336232707: creating Jul 09 01:16:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f457064e-dd89-4788-be38-7e96e446dcf2 tempest-GroupsV314Test-543901242 None] Group tempest-GroupsV314Test-Group-336232707: created successfully Jul 09 01:16:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f457064e-dd89-4788-be38-7e96e446dcf2 tempest-GroupsV314Test-543901242 None] Create group completed successfully. Jul 09 01:16:16 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.872s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:16 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be Jul 09 01:16:16 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-039cd95e-17c3-42b4-8b50-22f62427dbe9 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-59919de5-3422-4f41-8276-a1be0d7bc85e-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (8b631891-5d68-4e83-92bd-1d840c143fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8788ae9-60c2-4bba-b47a-f784b57cdbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8788ae9-60c2-4bba-b47a-f784b57cdbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2033777518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e58651-97af-41fd-98fc-8192fe9dc0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:17Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152a710e-b182-44ad-a1be-3d1e18cf53d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152a710e-b182-44ad-a1be-3d1e18cf53d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c4a0e8-99bf-4367-815d-3a62882c5afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c4a0e8-99bf-4367-815d-3a62882c5afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e58651-97af-41fd-98fc-8192fe9dc0a6', 'volume_name': 'volume-96e58651-97af-41fd-98fc-8192fe9dc0a6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d664f828-8fee-4865-9ce4-baab666aa2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d664f828-8fee-4865-9ce4-baab666aa2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155a0356-76fb-40bd-9248-07bf6bbf379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:17 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Volume 96e58651-97af-41fd-98fc-8192fe9dc0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e58651-97af-41fd-98fc-8192fe9dc0a6', 'volume_size': 1} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2033777518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e58651-97af-41fd-98fc-8192fe9dc0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:17Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Creating volume 96e58651-97af-41fd-98fc-8192fe9dc0a6 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:17 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 1073741824 Jul 09 01:16:17 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:17 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be" returned: 0 in 0.978s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:17 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be Jul 09 01:16:17 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:18 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Flow 'volume_create_manager' (de01ec38-f016-4d38-ab13-f00195b30a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df56b518-ba08-4533-8e0a-52c4eb9a30f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 1073741824" returned: 0 in 1.044s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df56b518-ba08-4533-8e0a-52c4eb9a30f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295175125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25269600-698b-49d9-bb86-6871edcc4009,host='devstack@QuobyteHD#QuobyteHD',id=1925f364-6aec-428b-9e82-6cd76decadba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9895e7fc0eca46028f8082fb40e1cd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:18Z,use_quota=True,user_id='71b5c3ed941b41af9f8112daf0aa8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f081233f-61dc-4481-99af-000f25a9ee55),volume_type_id=f081233f-61dc-4481-99af-000f25a9ee55)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff33c13-4249-4b1b-8431-97cc82c865e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff33c13-4249-4b1b-8431-97cc82c865e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336f94d1-db7d-43fe-bcc4-9111af485282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336f94d1-db7d-43fe-bcc4-9111af485282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1925f364-6aec-428b-9e82-6cd76decadba', 'volume_name': 'volume-1925f364-6aec-428b-9e82-6cd76decadba', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26bd11-31fe-493f-aa8f-d67c07ed4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26bd11-31fe-493f-aa8f-d67c07ed4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769b0a78-50ff-41b2-bed8-d8efb7c8a6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:18 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Volume 1925f364-6aec-428b-9e82-6cd76decadba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1925f364-6aec-428b-9e82-6cd76decadba', 'volume_size': 1} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:18 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d31f1232-ac95-4203-bab6-2854d45d97be" returned: 0 in 0.975s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-d31f1232-ac95-4203-bab6-2854d45d97be" released by "delete_volume" :: held 2.021s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:18 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 Jul 09 01:16:18 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['b4fe3d50-6f0b-4ef1-80d6-de2d52918545', '06721a1e-af05-4fd9-be44-b64954b61351', '85e9c412-5f74-4aeb-afe0-18172bca7731', 'ad16325f-785b-4a88-910c-559af1e67d2e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:18 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:18 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:18 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25269600-698b-49d9-bb86-6871edcc4009,created_at=2026-07-08T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295175125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25269600-698b-49d9-bb86-6871edcc4009,host='devstack@QuobyteHD#QuobyteHD',id=1925f364-6aec-428b-9e82-6cd76decadba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9895e7fc0eca46028f8082fb40e1cd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:18Z,use_quota=True,user_id='71b5c3ed941b41af9f8112daf0aa8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f081233f-61dc-4481-99af-000f25a9ee55),volume_type_id=f081233f-61dc-4481-99af-000f25a9ee55)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Creating volume 1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:18 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:18 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba 1073741824 Jul 09 01:16:18 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155a0356-76fb-40bd-9248-07bf6bbf379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e58651-97af-41fd-98fc-8192fe9dc0a6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73128b1-972c-4201-b78c-0e3d7c5e8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Volume volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 (96e58651-97af-41fd-98fc-8192fe9dc0a6): created successfully Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73128b1-972c-4201-b78c-0e3d7c5e8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (8b631891-5d68-4e83-92bd-1d840c143fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-606dfc37-a3f1-4908-9a14-b76b2a89b649 tempest-AttachVolumeTestJSON-1231346191 None] Created volume successfully. Jul 09 01:16:19 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.795s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-004ef44f-1492-47a1-9d3c-ad7c9f4a847d tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-d31f1232-ac95-4203-bab6-2854d45d97be-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-06765a11-2dcc-4b62-ad19-cff8a8815231-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-06765a11-2dcc-4b62-ad19-cff8a8815231-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-06765a11-2dcc-4b62-ad19-cff8a8815231" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-06765a11-2dcc-4b62-ad19-cff8a8815231" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleting offline snapshot 06765a11-2dcc-4b62-ad19-cff8a8815231 of volume 465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] snapshot_file for this snap is: volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27c5ac-da0f-4032-b841-0815b36101de]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:19 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 Jul 09 01:16:19 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:20 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba 1073741824" returned: 0 in 1.188s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:20 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:20 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:20 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231" returned: 0 in 1.030s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d09f5d-a25b-4912-bad6-dc2515084c8b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:20 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 Jul 09 01:16:20 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:20 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 0.792s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769b0a78-50ff-41b2-bed8-d8efb7c8a6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1925f364-6aec-428b-9e82-6cd76decadba', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66b608c-d519-4609-a196-7a90d1d10235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Volume volume-1925f364-6aec-428b-9e82-6cd76decadba (1925f364-6aec-428b-9e82-6cd76decadba): created successfully Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66b608c-d519-4609-a196-7a90d1d10235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Flow 'volume_create_manager' (de01ec38-f016-4d38-ab13-f00195b30a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fdf8c812-cf26-4a16-b683-06f5a6663bdb tempest-GroupsV314Test-543901242 None] Created volume successfully. Jul 09 01:16:21 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5" returned: 0 in 0.860s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:21 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 Jul 09 01:16:21 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:22 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231" returned: 0 in 0.794s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:22 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231 Jul 09 01:16:22 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22f560-2e20-4980-aea3-3a3104d2dd5a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:22 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 Jul 09 01:16:22 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:23 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5.06765a11-2dcc-4b62-ad19-cff8a8815231" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-06765a11-2dcc-4b62-ad19-cff8a8815231" released by "_delete_snapshot" :: held 3.560s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" released by "delete_snapshot" :: held 3.587s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['70bd7eeb-e1b4-49ca-9558-729d39b88c2a', 'ae5cf0a4-65af-4924-a240-4765a7e27d94', 'a6eb1532-53ee-41f4-82a1-22a621b9fdb0', '42c6f6c8-2c2f-4ebe-be3b-e0c9e2efbca6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Delete snapshot completed successfully. Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4074a468-51a5-4ebf-811a-51a92e1ebd04 tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-06765a11-2dcc-4b62-ad19-cff8a8815231-delete_snapshot" released by "delete_snapshot" :: held 3.792s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:23 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6" returned: 0 in 0.874s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.530s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Cloning volume 1925f364-6aec-428b-9e82-6cd76decadba to volume ef702a52-bce0-4740-8443-9d3e7c954541 Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Creating offline snapshot 2d930d01-3801-48dd-b0ce-8858df1b6548 of volume 1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-96e58651-97af-41fd-98fc-8192fe9dc0a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4474fbde-21b2-4e61-bd80-1aec334f25f0', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce53f937-9323-4944-97d2-a793b167dfcf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-5e8f50be-409b-4113-875d-6344cabf880d req-88ea9998-e8f9-4ce1-8c18-9a1ec6d52ee5 tempest-AttachVolumeTestJSON-1231346191 None] attachment_update completed successfully. Jul 09 01:16:23 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:23 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-465c8fc5-47aa-4fa1-81d8-403804e19fa5-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-465c8fc5-47aa-4fa1-81d8-403804e19fa5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170de26-5063-41af-a7df-cc174672356d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:24 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 Jul 09 01:16:24 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:24 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 1.095s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:24 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 1G Jul 09 01:16:24 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:25 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5" returned: 0 in 1.119s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:25 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5 Jul 09 01:16:25 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:25 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 1G" returned: 0 in 0.908s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1925f364-6aec-428b-9e82-6cd76decadba -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:25 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1925f364-6aec-428b-9e82-6cd76decadba -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:25 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:26 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-465c8fc5-47aa-4fa1-81d8-403804e19fa5" returned: 0 in 0.755s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-quobyte-465c8fc5-47aa-4fa1-81d8-403804e19fa5" released by "delete_volume" :: held 1.956s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Created reservations ['894e679f-4bd2-4fab-ab88-c9381077d540', '5aa7e63e-6df3-4b6d-8a02-b101cea8d80a', 'f162f422-220e-4317-a839-76c2d973d1b2', 'ebe93dd3-a53b-4731-b50c-59fd5991056c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:26 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:26 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:26 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1925f364-6aec-428b-9e82-6cd76decadba -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 1.141s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:26 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:16:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:26 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:26 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:27 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.014s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:27 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Deleted volume successfully. Jul 09 01:16:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-018c32b9-01e4-4ac2-9414-9db4f73332bb tempest-CreateVolumesFromSnapshotTest-1185952585 None] Lock "cinder-465c8fc5-47aa-4fa1-81d8-403804e19fa5-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:27 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 0.916s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:27 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info Jul 09 01:16:27 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:28 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info" returned: 0 in 0.885s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:28 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:16:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:28 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info Jul 09 01:16:28 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:29 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.info" returned: 0 in 1.291s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Acquiring lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] snapshot: 2d930d01-3801-48dd-b0ce-8858df1b6548, volume: ef702a52-bce0-4740-8443-9d3e7c954541, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9adac2-c756-44d4-aafe-bbca01bb74df]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:30 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:30 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (416ffbbe-e3fd-4cef-9bf8-e15282e1e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15d755f-45c0-4037-9444-b6302a2814c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15d755f-45c0-4037-9444-b6302a2814c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182604433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d98580f-ac86-4dfe-a4ab-559c24a9dc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:30Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772923d4-5fed-45d8-ad20-7bb042c82a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772923d4-5fed-45d8-ad20-7bb042c82a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07eb60-bbd2-4326-ae1c-82b7e0ddc9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07eb60-bbd2-4326-ae1c-82b7e0ddc9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d98580f-ac86-4dfe-a4ab-559c24a9dc4a', 'volume_name': 'volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7bf472-7512-4901-a98b-78dafd733694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7bf472-7512-4901-a98b-78dafd733694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d71720-068d-4ea5-bd0c-27a84105ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Volume 1d98580f-ac86-4dfe-a4ab-559c24a9dc4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a', 'volume_size': 1} Jul 09 01:16:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:31 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 1.047s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1925f364-6aec-428b-9e82-6cd76decadba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc92c92-ba03-4571-8281-d3a63fdcdb18]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:31 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:31 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:32 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 1.185s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:32 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:16:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:32 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 Jul 09 01:16:32 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:33 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:33 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:35 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.563s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:35 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:16:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:16:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Flow 'volume_create_manager' (8ca09812-f369-4972-a557-14d741369aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed0b40-463c-4927-98bd-8fbbfd9164df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed0b40-463c-4927-98bd-8fbbfd9164df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead47db3-e3e8-4501-b006-9e16d0679644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901457d11b4c409899a0d13fd61e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:36Z,use_quota=True,user_id='afb4904bc0c94475877a6e3e4e06fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabda2d3-795d-4098-84b0-3ae18d96ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabda2d3-795d-4098-84b0-3ae18d96ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbacc3d-cedd-4e09-a87c-85ee0788ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:36 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbacc3d-cedd-4e09-a87c-85ee0788ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ead47db3-e3e8-4501-b006-9e16d0679644', 'volume_name': 'volume-ead47db3-e3e8-4501-b006-9e16d0679644', 'volume_size': 1, 'image_id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a0b7106e84ba359c979d2997c1d664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '901457d11b4c409899a0d13fd61e86d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcdcc368568b33ca806ea540a7e44013a45f1c758e65d8ad361d0038b9096209d76a6d0644ba082cd7cd3217ca106ab5efaa1a2ae7712d60767ef9013c36538f', 'id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'created_at': datetime.datetime(2026, 7, 8, 23, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5208e77b-6393-48ac-a055-002cc96b0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5208e77b-6393-48ac-a055-002cc96b0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea50585e-15b5-4fef-91af-3a1587588ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Volume ead47db3-e3e8-4501-b006-9e16d0679644: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ead47db3-e3e8-4501-b006-9e16d0679644', 'volume_size': 1, 'image_id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a0b7106e84ba359c979d2997c1d664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '901457d11b4c409899a0d13fd61e86d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcdcc368568b33ca806ea540a7e44013a45f1c758e65d8ad361d0038b9096209d76a6d0644ba082cd7cd3217ca106ab5efaa1a2ae7712d60767ef9013c36538f', 'id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'created_at': datetime.datetime(2026, 7, 8, 23, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326/file', 'properties': {}}, 'image_service': } Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Trying to clone ead47db3-e3e8-4501-b006-9e16d0679644 from image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 at location (None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:16:37 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:16:37 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Image download 0.00 MB at 0.00 MB/s Jul 09 01:16:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b23a32-9796-4056-b59b-461047604e28]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:38 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:38 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:39 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541" returned: 0 in 7.270s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6007bd7-e05c-4819-8439-80bcbc9ce618]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:39 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:39 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:39 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 0 in 1.641s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:39 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:39 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:40 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 1 in 0.773s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Temporary image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 is fetched for user afb4904bc0c94475877a6e3e4e06fd55. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:16:40 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 0.982s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:16:40 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Converted 1024.00 MB image at 140.82 MB/s Jul 09 01:16:40 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:40 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 Jul 09 01:16:40 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9345fbc5-ab39-4257-8233-229f4596e82a]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:40 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:40 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:41 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541" returned: 0 in 0.702s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" released by "_copy_volume_from_snapshot" :: held 11.346s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Acquiring lock "cinder-quobyte-2d930d01-3801-48dd-b0ce-8858df1b6548" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-2d930d01-3801-48dd-b0ce-8858df1b6548" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Deleting offline snapshot 2d930d01-3801-48dd-b0ce-8858df1b6548 of volume 1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] snapshot_file for this snap is: volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c910f46-b9ea-4ae1-aa8a-56fa9bdda4bf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:41 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:41 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:41 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:41 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:41 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:42 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1925f364-6aec-428b-9e82-6cd76decadba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:16:42 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3561f3-71c2-4e23-89a3-592a08e90b94]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:42 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:42 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:42 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:42 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:42 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:43 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:43 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548 Jul 09 01:16:43 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:44 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba.2d930d01-3801-48dd-b0ce-8858df1b6548" returned: 0 in 0.642s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-2d930d01-3801-48dd-b0ce-8858df1b6548" released by "_delete_snapshot" :: held 3.055s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.898s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.797s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182604433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d98580f-ac86-4dfe-a4ab-559c24a9dc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2834b5e28694f0fba6c19a532f1defa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:30Z,use_quota=True,user_id='3eb0c7e6f86648afa3cd042385b59717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Creating volume 1d98580f-ac86-4dfe-a4ab-559c24a9dc4a {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:44 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:44 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a 1073741824 Jul 09 01:16:44 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-46ba575b-2622-4638-abe6-b15543840cb4 tempest-GroupsV314Test-543901242 None] Create group from source-group-25269600-698b-49d9-bb86-6871edcc4009 completed successfully. Jul 09 01:16:45 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a 1073741824" returned: 0 in 0.823s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:45 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a Jul 09 01:16:45 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Acquiring lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f9de5-b605-41c1-9f1e-f08839bf2877]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:45 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 Jul 09 01:16:45 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:45 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead47db3-e3e8-4501-b006-9e16d0679644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901457d11b4c409899a0d13fd61e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:36Z,use_quota=True,user_id='afb4904bc0c94475877a6e3e4e06fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Creating volume ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:45 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:45 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1073741824 Jul 09 01:16:45 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d71720-068d-4ea5-bd0c-27a84105ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4e701c-7210-4ebc-a591-b1fa619244a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:45 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Volume volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a (1d98580f-ac86-4dfe-a4ab-559c24a9dc4a): created successfully Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4e701c-7210-4ebc-a591-b1fa619244a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Flow 'volume_create_manager' (416ffbbe-e3fd-4cef-9bf8-e15282e1e725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-cc7e271a-2a5f-4a91-983a-324b24bda669 tempest-AttachVolumeTestJSON-1231346191 None] Created volume successfully. Jul 09 01:16:46 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541" returned: 0 in 0.778s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:46 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541 Jul 09 01:16:46 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:46 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1073741824" returned: 0 in 0.918s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:46 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:46 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:47 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ef702a52-bce0-4740-8443-9d3e7c954541" returned: 0 in 0.653s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-ef702a52-bce0-4740-8443-9d3e7c954541" released by "delete_volume" :: held 1.478s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Created reservations ['c157c10b-cea8-4ef4-b44f-402f774a9d90'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:47 devstack cinder-volume[86954]: WARNING cinder.quota [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-639607624 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-639607624, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:16:47 devstack cinder-volume[86954]: WARNING cinder.quota [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-639607624 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-639607624, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Created reservations ['e99b8389-e7c1-4d9a-9c0c-3f215e8bbb82', '2c6e395b-659a-465e-b2f2-c6261ae28da4', 'b78984bd-f0b5-4362-afb6-a77c16c4d159', '489058ed-30aa-48ee-a299-e6d72f6d65c6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:47 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:47 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:47 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 0 in 0.661s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Attempting download of 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 ((None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}])) to volume ead47db3-e3e8-4501-b006-9e16d0679644. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab3b82b-522e-4a33-8b17-aaf86c1f91b9]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:47 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz Jul 09 01:16:47 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:47 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.665s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:47 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ae9b3cab-5e50-4c99-b739-ef69481d59dd tempest-GroupsV314Test-543901242 None] Delete group completed successfully. Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Acquiring lock "cinder-quobyte-1925f364-6aec-428b-9e82-6cd76decadba" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-1925f364-6aec-428b-9e82-6cd76decadba" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5199d95-bbb8-4b32-a7c3-005a8d73f516]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:48 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:48 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:48 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz" returned: 0 in 0.758s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:48 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz Jul 09 01:16:48 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:49 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 0.817s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:49 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba Jul 09 01:16:49 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:49 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz" returned: 1 in 0.748s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_nt_ngydz' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3623167c-a170-4e50-8ebc-ea3bb59222ea]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:49 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:49 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f23663c-7ae3-44b9-8625-cb94c54c0efd]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:49 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1925f364-6aec-428b-9e82-6cd76decadba" returned: 0 in 0.733s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Lock "cinder-quobyte-1925f364-6aec-428b-9e82-6cd76decadba" released by "delete_volume" :: held 1.626s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:49 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a Jul 09 01:16:49 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Created reservations ['0d72e9f5-ba03-4903-b0b8-0e6fa29d9cf6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:49 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Created reservations ['bc2ce5ed-87de-4293-872c-a528400df8a5', '52833b53-7cf4-4fbe-99ea-714a0bc16fef', '47d20c88-efc5-487d-aaa2-cb5dda44138c', '54cc8e8d-b7f5-4d01-bfd1-a934da6dc8c9'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:50 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:50 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:50 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:50 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD Jul 09 01:16:50 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:50 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" returned: 0 in 1.039s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.068s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5565e65f-f97e-47d3-9531-34658c9665db', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:16:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-ecc4af64-a7b9-41ab-a587-cb079acdbd35 req-6bfcb29a-2ad0-4018-a204-c0b0538f5cc4 tempest-AttachVolumeTestJSON-1231346191 None] attachment_update completed successfully. Jul 09 01:16:50 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.791s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-14821c0b-fe02-447d-b14d-f1a0bf4b6810 tempest-GroupsV314Test-543901242 None] Delete group completed successfully. Jul 09 01:16:50 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 was raw, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:16:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:51 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:51 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:51 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 0 in 0.821s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:51 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27dc2aa4-6b55-4cd2-822e-5b5b2ae92326_u1dkl88fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:16:51 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 01:16:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:51 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1G Jul 09 01:16:51 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:52 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 1G" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e10b73d-1137-4a88-8772-8997a63a0170]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:52 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:52 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:53 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 0 in 1.019s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:53 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:53 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:54 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 1 in 0.914s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Downloaded image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 ((None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}])) to volume ead47db3-e3e8-4501-b006-9e16d0679644 successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Temporary image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 for user afb4904bc0c94475877a6e3e4e06fd55 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Marking volume ead47db3-e3e8-4501-b006-9e16d0679644 as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Copying metadata from image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 to ead47db3-e3e8-4501-b006-9e16d0679644. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Creating volume glance metadata for volume ead47db3-e3e8-4501-b006-9e16d0679644 backed by image 27dc2aa4-6b55-4cd2-822e-5b5b2ae92326 with: {'image_id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '36a0b7106e84ba359c979d2997c1d664', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea50585e-15b5-4fef-91af-3a1587588ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead47db3-e3e8-4501-b006-9e16d0679644', 'volume_size': 1, 'image_id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a0b7106e84ba359c979d2997c1d664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '901457d11b4c409899a0d13fd61e86d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcdcc368568b33ca806ea540a7e44013a45f1c758e65d8ad361d0038b9096209d76a6d0644ba082cd7cd3217ca106ab5efaa1a2ae7712d60767ef9013c36538f', 'id': '27dc2aa4-6b55-4cd2-822e-5b5b2ae92326', 'created_at': datetime.datetime(2026, 7, 8, 23, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27dc2aa4-6b55-4cd2-822e-5b5b2ae92326/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fc390c-89a9-428c-ad7d-519835a6684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:54 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Volume volume-ead47db3-e3e8-4501-b006-9e16d0679644 (ead47db3-e3e8-4501-b006-9e16d0679644): created successfully Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fc390c-89a9-428c-ad7d-519835a6684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Flow 'volume_create_manager' (8ca09812-f369-4972-a557-14d741369aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-66da11c4-286c-4e27-a876-b471d020fb22 tempest-VolumeImageDependencyTests-1951665113 None] Created volume successfully. Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Acquiring lock "cinder-ead47db3-e3e8-4501-b006-9e16d0679644-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "cinder-ead47db3-e3e8-4501-b006-9e16d0679644-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Acquiring lock "cinder-quobyte-ead47db3-e3e8-4501-b006-9e16d0679644" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "cinder-quobyte-ead47db3-e3e8-4501-b006-9e16d0679644" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5addb01-a156-41db-8a2c-8b7febf81b84]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:55 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:55 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:56 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:56 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:56 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-14776d18-8f93-47e0-bf8b-86d491ba64ef req-bbef6f1e-d1ca-4db3-ba87-5cef0cf63cc4 tempest-AttachVolumeTestJSON-1231346191 None] Terminate volume connection completed successfully. Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-14776d18-8f93-47e0-bf8b-86d491ba64ef req-bbef6f1e-d1ca-4db3-ba87-5cef0cf63cc4 tempest-AttachVolumeTestJSON-1231346191 None] Deleting attachment 4474fbde-21b2-4e61-bd80-1aec334f25f0. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Flow 'volume_create_manager' (6a7bd2b2-75e6-4e13-b4c9-28af96752f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f63ad1-590e-48cf-8b3b-6325f18b9ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f63ad1-590e-48cf-8b3b-6325f18b9ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1715160566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1a9d2ed9c4219810ebaa4f0743f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:57Z,use_quota=True,user_id='927541a95c1144f895c2dd6363889a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46170e44-d936-49c8-92a8-ba59751d8531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46170e44-d936-49c8-92a8-ba59751d8531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e767c9b4-94c9-4e31-b18a-35ecd325b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e767c9b4-94c9-4e31-b18a-35ecd325b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399', 'volume_name': 'volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73cf00a-3282-4ff8-942f-1a26b796889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73cf00a-3282-4ff8-942f-1a26b796889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5dceb5-d493-49c5-bb18-48f01f6be7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:57 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Volume e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399', 'volume_size': 1} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1715160566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc1a9d2ed9c4219810ebaa4f0743f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:16:57Z,use_quota=True,user_id='927541a95c1144f895c2dd6363889a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Creating volume e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:16:57 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:57 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 1073741824 Jul 09 01:16:57 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:57 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 1 in 0.961s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:16:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:57 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644 Jul 09 01:16:57 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:58 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 1073741824" returned: 0 in 1.020s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:58 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 Jul 09 01:16:58 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:58 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ead47db3-e3e8-4501-b006-9e16d0679644" returned: 0 in 0.777s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "cinder-quobyte-ead47db3-e3e8-4501-b006-9e16d0679644" released by "delete_volume" :: held 2.562s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Created reservations ['aba5c324-d50b-49c7-8522-290cd5c4007d', '0b0533a3-4de1-4f96-ae8c-c3d697c4b846', 'ea85ca3c-ea54-44f7-9bde-ef58c1b5f59f', '4951c03d-014c-4bc1-b348-e4d0b9034f2a'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:58 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:16:58 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:16:58 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" returned: 0 in 0.686s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5dceb5-d493-49c5-bb18-48f01f6be7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8479364d-fdcd-47ce-9716-2d381c1d9a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:16:58 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Volume volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 (e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399): created successfully Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8479364d-fdcd-47ce-9716-2d381c1d9a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:16:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Flow 'volume_create_manager' (6a7bd2b2-75e6-4e13-b4c9-28af96752f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:16:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-048bbd5c-fd5d-4dfa-9da2-8af912bfd5d5 tempest-VolumesServicesTestJSON-780302763 None] Created volume successfully. Jul 09 01:16:59 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.774s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:16:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Deleted volume successfully. Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-29eb082d-062e-47ae-9481-6a279be3d014 tempest-VolumeImageDependencyTests-1951665113 None] Lock "cinder-ead47db3-e3e8-4501-b006-9e16d0679644-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Acquiring lock "cinder-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "cinder-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Acquiring lock "cinder-quobyte-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "cinder-quobyte-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f06d11e-27bf-45c7-8f04-3e6ca6d6acb6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:16:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-51200be3-d6b1-49c9-89ac-3a5537dfe3ef req-2cd22e05-9741-4ea1-b350-d390bf60e08f tempest-AttachVolumeTestJSON-1231346191 None] Terminate volume connection completed successfully. Jul 09 01:16:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-51200be3-d6b1-49c9-89ac-3a5537dfe3ef req-2cd22e05-9741-4ea1-b350-d390bf60e08f tempest-AttachVolumeTestJSON-1231346191 None] Deleting attachment 5565e65f-f97e-47d3-9531-34658c9665db. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:16:59 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 Jul 09 01:16:59 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:00 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" returned: 0 in 0.951s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:00 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399 Jul 09 01:17:00 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Acquiring lock "cinder-d29a349a-a407-4831-b441-2267407c4c33-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "cinder-d29a349a-a407-4831-b441-2267407c4c33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Acquiring lock "cinder-quobyte-d29a349a-a407-4831-b441-2267407c4c33" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "cinder-quobyte-d29a349a-a407-4831-b441-2267407c4c33" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef03e5b-9329-48a0-9d1b-7fe5993cfee6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:00 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 Jul 09 01:17:00 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:01 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "cinder-quobyte-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399" released by "delete_volume" :: held 1.805s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Created reservations ['1d5b81fa-1434-43dd-8dfd-720d24f8b9d2', 'e536eea9-e32a-4e88-bf69-6e66771504cf', 'd6747c37-5f8b-443b-aabb-df7d0d42599a', 'ec1220a9-a961-4d30-a1d2-119f3c4f48a2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:01 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:01 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:01 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33" returned: 0 in 0.909s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:01 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33 Jul 09 01:17:01 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:02 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.995s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Deleted volume successfully. Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-188c7fed-6c8b-4fa3-9dd1-0c28c33b3939 tempest-VolumesServicesTestJSON-780302763 None] Lock "cinder-e40b9f1d-1db1-49a8-ba13-dfaeeb5a7399-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:02 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d29a349a-a407-4831-b441-2267407c4c33" returned: 0 in 1.060s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "cinder-quobyte-d29a349a-a407-4831-b441-2267407c4c33" released by "delete_volume" :: held 2.022s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Created reservations ['6b9d2382-218c-4a3b-be9d-6290768dc0bb', '190df1e6-04b6-4a8e-84c6-9dd05d7ee8e8', '4ae7e139-6453-4a8a-9b31-cf4b330d7f41', 'abe5c885-2652-41d9-b468-333cd6739f69'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:02 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:02 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Flow 'volume_create_manager' (e2a6d2ab-387f-4bce-bdd3-1c7f74442da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea67762-2d08-4f51-bfc5-40f46cd5de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea67762-2d08-4f51-bfc5-40f46cd5de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f0663-a0ee-41d8-a309-1ea8a97929ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0bef437c148f4a181e27e6de5ca04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:03Z,use_quota=True,user_id='d7ee39923122461aae8ef3a96b0a3204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4195dd78-c6b3-4ff3-bc97-647db99d8ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4195dd78-c6b3-4ff3-bc97-647db99d8ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1887a97-810b-4312-9d3e-6aeeab869044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1887a97-810b-4312-9d3e-6aeeab869044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8f0663-a0ee-41d8-a309-1ea8a97929ab', 'volume_name': 'volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a58b10f-3c82-4e4f-8104-b739d5b29c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a58b10f-3c82-4e4f-8104-b739d5b29c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2095b5-a8f1-4859-b521-6ab54f09d5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Volume 3d8f0663-a0ee-41d8-a309-1ea8a97929ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab', 'volume_size': 1} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f0663-a0ee-41d8-a309-1ea8a97929ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0bef437c148f4a181e27e6de5ca04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:03Z,use_quota=True,user_id='d7ee39923122461aae8ef3a96b0a3204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Creating volume 3d8f0663-a0ee-41d8-a309-1ea8a97929ab {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:03 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:03 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab 1073741824 Jul 09 01:17:03 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:03 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.906s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Deleted volume successfully. Jul 09 01:17:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f27113f3-4c6d-41da-971e-3bc8ff6723d3 tempest-AttachVolumeShelveTestJSON-488298608 None] Lock "cinder-d29a349a-a407-4831-b441-2267407c4c33-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:04 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab 1073741824" returned: 0 in 1.341s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:04 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=116,cinder:INSERT=38,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:17:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:04 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab Jul 09 01:17:04 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:05 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" returned: 0 in 0.749s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2095b5-a8f1-4859-b521-6ab54f09d5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d700f-a8ca-4d4a-b8eb-61e00f20e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:05 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Volume volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab (3d8f0663-a0ee-41d8-a309-1ea8a97929ab): created successfully Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d700f-a8ca-4d4a-b8eb-61e00f20e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Flow 'volume_create_manager' (e2a6d2ab-387f-4bce-bdd3-1c7f74442da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:05 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=135,cinder:SELECT=101,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:17:05 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-10ae93cb-aaaa-4252-8889-82f5390c990e tempest-CinderUnicodeTest-311636147 None] Created volume successfully. Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Flow 'volume_create_manager' (53334d6f-abe5-4f98-a5cf-6d44f270c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9880dca3-72bc-4619-8347-47c6bdf7911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9880dca3-72bc-4619-8347-47c6bdf7911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1936419878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf169a8-26e8-453b-9d11-a54dc004a196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0bef437c148f4a181e27e6de5ca04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:07Z,use_quota=True,user_id='d7ee39923122461aae8ef3a96b0a3204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b0307-5947-43ab-ade7-3ca380e80c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0b0307-5947-43ab-ade7-3ca380e80c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44454a3-ea68-424c-99dc-dbfdd7bc72ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44454a3-ea68-424c-99dc-dbfdd7bc72ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf169a8-26e8-453b-9d11-a54dc004a196', 'volume_name': 'volume-2cf169a8-26e8-453b-9d11-a54dc004a196', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e69459b-81ba-4ca5-95c8-b3448e80a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e69459b-81ba-4ca5-95c8-b3448e80a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba515f29-315a-46a4-9d65-8cf6a80515c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:07 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Volume 2cf169a8-26e8-453b-9d11-a54dc004a196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf169a8-26e8-453b-9d11-a54dc004a196', 'volume_size': 1} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1936419878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf169a8-26e8-453b-9d11-a54dc004a196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0bef437c148f4a181e27e6de5ca04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:07Z,use_quota=True,user_id='d7ee39923122461aae8ef3a96b0a3204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Creating volume 2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:07 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:07 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 1073741824 Jul 09 01:17:07 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:08 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 1073741824" returned: 0 in 1.093s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:08 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 Jul 09 01:17:08 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:08 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196" returned: 0 in 0.761s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba515f29-315a-46a4-9d65-8cf6a80515c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf169a8-26e8-453b-9d11-a54dc004a196', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba51ebeb-3b2e-42f0-91d2-56aa6955b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Volume volume-2cf169a8-26e8-453b-9d11-a54dc004a196 (2cf169a8-26e8-453b-9d11-a54dc004a196): created successfully Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba51ebeb-3b2e-42f0-91d2-56aa6955b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Flow 'volume_create_manager' (53334d6f-abe5-4f98-a5cf-6d44f270c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4aa6de5f-da00-4efa-8894-cc535405983b tempest-CinderUnicodeTest-311636147 None] Created volume successfully. Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Flow 'volume_create_manager' (a774a970-e87e-4feb-a44f-0a6cdd403125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a1f1ad-a4f6-43d3-8d1b-0198ba5ab232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a1f1ad-a4f6-43d3-8d1b-0198ba5ab232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1607058352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b35cf9-48ae-46fa-9682-9c55d535a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daa12a12d4349bb8b3fc75f1dd1d181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:10Z,use_quota=True,user_id='3d0389eb19b14261841a1670445205df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05362ffb-5031-465d-a9bb-d01db46f3226),volume_type_id=05362ffb-5031-465d-a9bb-d01db46f3226)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0de23c-31e6-4ff4-9fcc-24bb5b6ed630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0de23c-31e6-4ff4-9fcc-24bb5b6ed630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b6cb2-5d7b-420d-9ad9-1edd9aeb58d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b6cb2-5d7b-420d-9ad9-1edd9aeb58d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b35cf9-48ae-46fa-9682-9c55d535a7a9', 'volume_name': 'volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba2a941-1fa3-40ee-96d9-0868d00a307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba2a941-1fa3-40ee-96d9-0868d00a307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99801276-8c96-425c-b513-d31d5717bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Volume e9b35cf9-48ae-46fa-9682-9c55d535a7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9', 'volume_size': 1} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1607058352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b35cf9-48ae-46fa-9682-9c55d535a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daa12a12d4349bb8b3fc75f1dd1d181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:10Z,use_quota=True,user_id='3d0389eb19b14261841a1670445205df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05362ffb-5031-465d-a9bb-d01db46f3226),volume_type_id=05362ffb-5031-465d-a9bb-d01db46f3226)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Creating volume e9b35cf9-48ae-46fa-9682-9c55d535a7a9 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:09 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:09 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 1073741824 Jul 09 01:17:09 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:10 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 1073741824" returned: 0 in 1.081s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:10 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 Jul 09 01:17:10 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-quobyte-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[726614c3-7d53-4e02-abfc-cbd2b84184e4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:11 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a Jul 09 01:17:11 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:11 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" returned: 0 in 0.696s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.088s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Creating offline snapshot 5f68cf5b-4400-4e27-99e1-6e6ca925b3dd of volume 2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99801276-8c96-425c-b513-d31d5717bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd81ef-c85d-4c1c-843f-6d5e9eafcbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536ef11-9ba6-474c-b951-0c94a3d96532]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Volume volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 (e9b35cf9-48ae-46fa-9682-9c55d535a7a9): created successfully Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd81ef-c85d-4c1c-843f-6d5e9eafcbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Flow 'volume_create_manager' (a774a970-e87e-4feb-a44f-0a6cdd403125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:11 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0be5721f-9def-472e-9b54-83888c0c1645 tempest-VolumeTypesAccessTest-1734282858 None] Created volume successfully. Jul 09 01:17:11 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 Jul 09 01:17:11 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:11 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:11 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a Jul 09 01:17:11 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:12 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:12 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd 1G Jul 09 01:17:12 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:12 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a" released by "delete_volume" :: held 1.547s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Created reservations ['63f120ca-8020-49ca-9666-e34175f0a76d', 'e5771a77-2856-4970-9c06-968fe8624f43', '6cfdc9ab-42f4-4a78-8c09-3313f1b5ce19', '55c77c20-cc06-479b-8746-770be71d6f4c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:12 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:12 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1fec5783-7744-4ce7-97f9-47fe6fc880e1 tempest-BackendsCapabilitiesAdminTestsJSON-673177168 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545356750488, 'free_capacity_gb': 1775.7545356750488, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86954) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Acquiring lock "cinder-e9b35cf9-48ae-46fa-9682-9c55d535a7a9-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "cinder-e9b35cf9-48ae-46fa-9682-9c55d535a7a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Acquiring lock "cinder-quobyte-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "cinder-quobyte-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c16dc-7adf-420e-8b55-a6dbe79a3a6d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:13 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 Jul 09 01:17:13 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-96e58651-97af-41fd-98fc-8192fe9dc0a6-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-96e58651-97af-41fd-98fc-8192fe9dc0a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-quobyte-96e58651-97af-41fd-98fc-8192fe9dc0a6" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-96e58651-97af-41fd-98fc-8192fe9dc0a6" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f028e5-21cd-437e-a77c-836698542e14]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:13 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd 1G" returned: 0 in 0.886s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf169a8-26e8-453b-9d11-a54dc004a196 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:13 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf169a8-26e8-453b-9d11-a54dc004a196 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd Jul 09 01:17:13 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5387c7ca-a3bc-4fe5-b4f0-7b52edd0614f tempest-BackendsCapabilitiesAdminTestsJSON-673177168 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545356750488, 'free_capacity_gb': 1775.7545356750488, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86954) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 01:17:13 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 Jul 09 01:17:13 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:13 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.788s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Deleted volume successfully. Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1edbeeac-6973-4b7a-8a86-cbdef0bfb823 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-1d98580f-ac86-4dfe-a4ab-559c24a9dc4a-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:13 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" returned: 0 in 0.895s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:13 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9 Jul 09 01:17:13 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:14 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf169a8-26e8-453b-9d11-a54dc004a196 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" returned: 0 in 0.726s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:14 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd is being set with open permissions: ugo+rw Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:14 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd Jul 09 01:17:14 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:14 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:14 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6 Jul 09 01:17:14 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:14 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" returned: 0 in 0.739s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "cinder-quobyte-e9b35cf9-48ae-46fa-9682-9c55d535a7a9" released by "delete_volume" :: held 1.679s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:14 devstack cinder-volume[86954]: WARNING cinder.quota [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-60384609 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-60384609, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:17:14 devstack cinder-volume[86954]: WARNING cinder.quota [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-60384609 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-60384609, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Created reservations ['70bbeeca-6e9a-42f0-a1f6-88a42bd4d4ac', 'b22e75e3-62d2-4711-90ee-596a691957fa', 'b2ac7dc7-cead-4351-b154-0b2895359cd2', '94f56406-c891-4ac3-8536-59ab891588d6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:14 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:14 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:14 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-96e58651-97af-41fd-98fc-8192fe9dc0a6" returned: 0 in 0.736s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:14 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" returned: 0 in 0.843s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-96e58651-97af-41fd-98fc-8192fe9dc0a6" released by "delete_volume" :: held 1.628s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:14 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info Jul 09 01:17:14 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Created reservations ['8460a896-fded-4832-bdcb-838e11fbea96', 'de84f8ef-8b81-44d0-8748-6469c57f6cfc', '485d0eef-85af-4613-aefd-b2b25850da3c', '23965712-03bb-4d16-a2d1-b553ffefe5e1'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:15 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:15 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:15 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.003s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Deleted volume successfully. Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-495cb4f7-9914-449f-a64b-fffa8ca8e6ca tempest-VolumeTypesAccessTest-1734282858 None] Lock "cinder-e9b35cf9-48ae-46fa-9682-9c55d535a7a9-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "cinder-quobyte-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:15 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info" returned: 0 in 0.987s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:15 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info is being set with open permissions: ugo+rw Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe94c3d-c168-43e6-b3de-d09ffac8ed88]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:16 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info Jul 09 01:17:16 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:16 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.987s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Deleted volume successfully. Jul 09 01:17:16 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f Jul 09 01:17:16 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8ddd6f2-3b14-4f8e-adcf-0895c08f3769 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-96e58651-97af-41fd-98fc-8192fe9dc0a6-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:16 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.info" returned: 0 in 0.916s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.277s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7233346c-2197-47bf-bf66-91040d611e78 tempest-CinderUnicodeTest-311636147 None] Create snapshot completed successfully Jul 09 01:17:16 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" returned: 0 in 0.991s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:16 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f Jul 09 01:17:17 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:17 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-quobyte-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f" released by "delete_volume" :: held 1.839s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Created reservations ['b048afbe-c556-4a9e-b408-2399dd2c9c21', '6e148d72-169a-4918-a333-0a6163debea2', '8e3c9a81-2b17-4196-8338-2a0586010d33', '8189f24e-2a75-4082-ab44-1f198100306b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:17 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:17 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-quobyte-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Deleting offline snapshot 5f68cf5b-4400-4e27-99e1-6e6ca925b3dd of volume 2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:17:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] snapshot_file for this snap is: volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:17:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de9ef6-4800-4fd6-9991-190e5c5ca842]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:18 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd Jul 09 01:17:18 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:19 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.166s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:19 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Deleted volume successfully. Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" returned: 0 in 1.022s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf169a8-26e8-453b-9d11-a54dc004a196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fe1ec-dcbc-4077-8f88-4e080fa0cfcf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ec4665fb-7a13-4dc8-a36a-5de16d5b89a6 tempest-AttachVolumeTestJSON-1231346191 None] Lock "cinder-31ff9f0e-937c-4ac6-9e62-cd1ffaf6492f-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:19 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 Jul 09 01:17:19 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:20 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196" returned: 0 in 0.896s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:20 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd Jul 09 01:17:20 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1a86423e-ec77-463c-9a98-09bc38189e47 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-967966830: creating Jul 09 01:17:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1a86423e-ec77-463c-9a98-09bc38189e47 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-967966830: created successfully Jul 09 01:17:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1a86423e-ec77-463c-9a98-09bc38189e47 tempest-GroupSnapshotsTest-1177914110 None] Create group completed successfully. Jul 09 01:17:21 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" returned: 0 in 0.963s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:21 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd Jul 09 01:17:21 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:21 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196.5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" returned: 0 in 0.836s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd" released by "_delete_snapshot" :: held 3.890s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" released by "delete_snapshot" :: held 3.935s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:21 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Created reservations ['13d3ed44-733a-4e06-8762-b25c475ec3aa', 'da135a67-4ea7-41f2-8aac-d1bb7ebe1dc5', '42c9f863-2711-4b85-b7fa-6c24bd661064', '7cd30768-04c0-4ecc-ab5d-9428a30a09e3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Delete snapshot completed successfully. Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1910b22e-5deb-4062-8cb0-0a62f06793b4 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-5f68cf5b-4400-4e27-99e1-6e6ca925b3dd-delete_snapshot" released by "delete_snapshot" :: held 4.104s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-2cf169a8-26e8-453b-9d11-a54dc004a196-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "cinder-2cf169a8-26e8-453b-9d11-a54dc004a196-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ef59b-28c8-4d17-9067-33d857f7c190]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:22 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 Jul 09 01:17:22 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (4c809538-bd8d-4faf-8f9b-8e99c60f2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54695b70-6c58-4224-8888-7a06d00d7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54695b70-6c58-4224-8888-7a06d00d7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238292501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3aa1f1e-2a76-4ce5-8ffb-8613091f302e,host='devstack@QuobyteHD#QuobyteHD',id=72d102bd-8fc2-4e86-bbba-03428b711256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:23Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ead11b-50f8-47cc-bc38-a1583e3a761e),volume_type_id=12ead11b-50f8-47cc-bc38-a1583e3a761e)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2ee285-77c3-4b10-82c6-55f7474042d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2ee285-77c3-4b10-82c6-55f7474042d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26868059-ac1c-4adb-bfe8-5cc29a025789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26868059-ac1c-4adb-bfe8-5cc29a025789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d102bd-8fc2-4e86-bbba-03428b711256', 'volume_name': 'volume-72d102bd-8fc2-4e86-bbba-03428b711256', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c8a807-7daa-412d-b07b-dabbf14a957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c8a807-7daa-412d-b07b-dabbf14a957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0c1cc2-622f-43ac-b2eb-021665f70f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Volume 72d102bd-8fc2-4e86-bbba-03428b711256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d102bd-8fc2-4e86-bbba-03428b711256', 'volume_size': 1} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3aa1f1e-2a76-4ce5-8ffb-8613091f302e,created_at=2026-07-08T23:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238292501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3aa1f1e-2a76-4ce5-8ffb-8613091f302e,host='devstack@QuobyteHD#QuobyteHD',id=72d102bd-8fc2-4e86-bbba-03428b711256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:23Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ead11b-50f8-47cc-bc38-a1583e3a761e),volume_type_id=12ead11b-50f8-47cc-bc38-a1583e3a761e)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Creating volume 72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:22 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:22 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 1073741824 Jul 09 01:17:22 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:23 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196" returned: 0 in 1.103s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:23 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196 Jul 09 01:17:23 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:23 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 1073741824" returned: 0 in 1.116s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:24 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:24 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:24 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2cf169a8-26e8-453b-9d11-a54dc004a196" returned: 0 in 0.902s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-2cf169a8-26e8-453b-9d11-a54dc004a196" released by "delete_volume" :: held 2.085s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Created reservations ['bbfb63c0-9d99-448e-99fe-6c492d1d489a', 'd6489965-d3e1-414a-9dab-b4526cbd0603', '32c20403-565b-4e47-a2f4-720fb5199920', '1be1af88-b3f5-4929-8e6e-3f5301b7c818'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:24 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:24 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:24 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.836s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0c1cc2-622f-43ac-b2eb-021665f70f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d102bd-8fc2-4e86-bbba-03428b711256', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857dae91-e7f3-410a-823c-56661941b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Volume volume-72d102bd-8fc2-4e86-bbba-03428b711256 (72d102bd-8fc2-4e86-bbba-03428b711256): created successfully Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857dae91-e7f3-410a-823c-56661941b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (4c809538-bd8d-4faf-8f9b-8e99c60f2093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e8e1ce69-1ca8-4f41-acfc-46ee5fecffad tempest-GroupSnapshotsTest-1177914110 None] Created volume successfully. Jul 09 01:17:25 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.837s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Deleted volume successfully. Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bc038f82-777b-49ac-8bd0-d2657531805b tempest-CinderUnicodeTest-311636147 None] Lock "cinder-2cf169a8-26e8-453b-9d11-a54dc004a196-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] GroupSnapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: creating. Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Group snapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: creating. {{(pid=86954) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Creating offline snapshot 3267506f-1bd8-4039-8a59-45fa0b5ce8bd of volume 72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd063b70-af99-4822-9832-5e2a4b90a622]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-3d8f0663-a0ee-41d8-a309-1ea8a97929ab-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-3d8f0663-a0ee-41d8-a309-1ea8a97929ab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "cinder-quobyte-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:25 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:25 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb32ddce-165e-4c96-bcd4-cb7c5ed2a27e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:25 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab Jul 09 01:17:25 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:26 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.923s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:26 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd 1G Jul 09 01:17:26 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:26 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" returned: 0 in 1.053s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:26 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab Jul 09 01:17:26 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Flow 'volume_create_manager' (7127a573-3372-4a9d-8bb6-af67ec044059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:27 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b3bb19-57d0-4ecd-9e3f-67a4cc1f0ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd 1G" returned: 0 in 1.030s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d102bd-8fc2-4e86-bbba-03428b711256 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b3bb19-57d0-4ecd-9e3f-67a4cc1f0ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1418694418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2b0959-95d6-4abd-846a-06d83d12e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c11c99c07fc4ed7bc31696dde8c84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:28Z,use_quota=True,user_id='8275bb0e16e04984870e936ba08c833c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917577a8-a996-457b-ae5a-619fa5f2d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917577a8-a996-457b-ae5a-619fa5f2d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a99c-6804-49e4-a46e-2c5a130ffbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:27 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d102bd-8fc2-4e86-bbba-03428b711256 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a99c-6804-49e4-a46e-2c5a130ffbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2b0959-95d6-4abd-846a-06d83d12e59b', 'volume_name': 'volume-3e2b0959-95d6-4abd-846a-06d83d12e59b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:27 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242a6d8-5177-45d9-8948-cae3589ba5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242a6d8-5177-45d9-8948-cae3589ba5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c8255a-a4d9-4646-8dab-db188426a0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Volume 3e2b0959-95d6-4abd-846a-06d83d12e59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2b0959-95d6-4abd-846a-06d83d12e59b', 'volume_size': 1} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:27 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-quobyte-3d8f0663-a0ee-41d8-a309-1ea8a97929ab" released by "delete_volume" :: held 1.925s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Created reservations ['1a217280-bb7d-4d37-9e52-1651612bce95', 'e76296af-6c17-49f8-8785-736d4efb2baa', '0fa73f7b-ce76-4f25-be27-81ac4e4cde55', 'c470fe5f-f068-4d0b-b446-db1c81dea219'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:27 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:27 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:28 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d102bd-8fc2-4e86-bbba-03428b711256 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.925s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:28 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:17:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:28 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:28 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:28 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.844s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Deleted volume successfully. Jul 09 01:17:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7218a2be-2a2a-4736-bebf-64cf2ac1fe77 tempest-CinderUnicodeTest-311636147 None] Lock "cinder-3d8f0663-a0ee-41d8-a309-1ea8a97929ab-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:29 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:29 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info Jul 09 01:17:29 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:30 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:30 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:30 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info Jul 09 01:17:30 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:30 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.info" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.091s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.020s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1418694418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2b0959-95d6-4abd-846a-06d83d12e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c11c99c07fc4ed7bc31696dde8c84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:28Z,use_quota=True,user_id='8275bb0e16e04984870e936ba08c833c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Creating volume 3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:30 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:30 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b 1073741824 Jul 09 01:17:30 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-af78f1ff-e3cc-48ac-8b11-a0d11d836989 tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: created successfully Jul 09 01:17:31 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b 1073741824" returned: 0 in 0.971s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:31 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b Jul 09 01:17:31 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:32 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.269s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd-6ba82fc8-05a3-449a-b074-c73aca3af839" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c8255a-a4d9-4646-8dab-db188426a0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2b0959-95d6-4abd-846a-06d83d12e59b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190e4fda-3054-4874-af95-111db8edc62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd-6ba82fc8-05a3-449a-b074-c73aca3af839" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Creating volume 6ba82fc8-05a3-449a-b074-c73aca3af839 from snapshot 3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:32 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Volume volume-3e2b0959-95d6-4abd-846a-06d83d12e59b (3e2b0959-95d6-4abd-846a-06d83d12e59b): created successfully Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190e4fda-3054-4874-af95-111db8edc62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Flow 'volume_create_manager' (7127a573-3372-4a9d-8bb6-af67ec044059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] snapshot: 3267506f-1bd8-4039-8a59-45fa0b5ce8bd, volume: 6ba82fc8-05a3-449a-b074-c73aca3af839, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:17:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-0874d635-ecd7-43bc-b7a8-942b6f63dcc7 req-57373e49-af78-4813-9e9f-62e3907ec7e0 tempest-VolumesSnapshotsTestJSON-969593453 None] Created volume successfully. Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da89cc-8699-4685-bc31-5581df5894c4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Flow 'volume_create_manager' (99b2c1ec-3e9d-4bfe-bab9-e2446826ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:32 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:32 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b1e74d-4589-4ce2-a873-f30a9c2f909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b1e74d-4589-4ce2-a873-f30a9c2f909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039628316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3bde42-a1eb-4b52-a50a-1d0133c9cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe9afec3d414d86bc4bb842c56b5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:33Z,use_quota=True,user_id='153e8e6708e947b6af98dddcfd316900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a288912-fcf5-478d-ba80-e561f2580fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a288912-fcf5-478d-ba80-e561f2580fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ba474-80a0-4090-9a9a-6bfdf722ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ba474-80a0-4090-9a9a-6bfdf722ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3bde42-a1eb-4b52-a50a-1d0133c9cc64', 'volume_name': 'volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611dfd68-06c6-4fab-a971-173ecc55be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611dfd68-06c6-4fab-a971-173ecc55be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8566d-6eb8-4aed-8551-0b8266423b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Volume 1a3bde42-a1eb-4b52-a50a-1d0133c9cc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64', 'volume_size': 1} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:33 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.922s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d102bd-8fc2-4e86-bbba-03428b711256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c44b4db-c614-4f43-83dc-fbf76a29b209]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:33 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:33 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:33 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:33 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:34 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.835s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:17:34 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.991s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:17:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:34 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 Jul 09 01:17:34 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (99e62e95-c4dc-497c-b578-f08e57de03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda4aef4-5bfb-47c5-b1e9-a398b3ec04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda4aef4-5bfb-47c5-b1e9-a398b3ec04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1113648808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142cc91-bf55-4a9b-ba92-05c593425c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e857ee4aaf44b0a6f7b70aa367d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:37Z,use_quota=True,user_id='dc1117b0f0ab4068b214fb9e7053cf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed98bb6-f664-4c56-9743-4e2771826e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed98bb6-f664-4c56-9743-4e2771826e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274717f8-3f0a-46ed-a19f-18aff3c0c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274717f8-3f0a-46ed-a19f-18aff3c0c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9142cc91-bf55-4a9b-ba92-05c593425c65', 'volume_name': 'volume-9142cc91-bf55-4a9b-ba92-05c593425c65', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdaede5-d706-4070-8dbf-2244de0b3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdaede5-d706-4070-8dbf-2244de0b3742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1588ed7-dbda-45d2-981d-a50b9c49b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Volume 9142cc91-bf55-4a9b-ba92-05c593425c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9142cc91-bf55-4a9b-ba92-05c593425c65', 'volume_size': 1} Jul 09 01:17:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:39 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839" returned: 0 in 4.855s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a46d1b-8b48-40fd-b791-8fe11673c791]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:39 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:39 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:40 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.907s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:40 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:17:40 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Converted 1024.00 MB image at 210.87 MB/s Jul 09 01:17:40 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:17:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:40 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 Jul 09 01:17:40 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:41 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839" returned: 0 in 0.633s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" released by "_copy_volume_from_snapshot" :: held 8.431s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd-6ba82fc8-05a3-449a-b074-c73aca3af839" released by "_create_volume_from_snapshot" :: held 8.490s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.530s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.155s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039628316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3bde42-a1eb-4b52-a50a-1d0133c9cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe9afec3d414d86bc4bb842c56b5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:33Z,use_quota=True,user_id='153e8e6708e947b6af98dddcfd316900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Creating volume 1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:41 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:41 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 1073741824 Jul 09 01:17:41 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d9b66bce-4f36-4a46-977f-9737021cf647 tempest-GroupSnapshotsTest-1177914110 None] Create group from source-snapshot-757968b8-fa90-45a2-a7d1-c58b82b340e9 completed successfully. Jul 09 01:17:42 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 1073741824" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:42 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 Jul 09 01:17:42 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:42 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.846s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Creating offline snapshot f48afb14-1293-459d-9a96-cb3eedd635e4 of volume 3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8566d-6eb8-4aed-8551-0b8266423b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01d22a3-e3a5-46d1-9915-65b7e4abeb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d942f-897b-4adf-9bba-ae5e237a6e3b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Volume volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 (1a3bde42-a1eb-4b52-a50a-1d0133c9cc64): created successfully Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01d22a3-e3a5-46d1-9915-65b7e4abeb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Flow 'volume_create_manager' (99b2c1ec-3e9d-4bfe-bab9-e2446826ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4bf9d0b7-ae23-48be-9054-a302550995be tempest-ProjectReaderTests-1563814237 None] Created volume successfully. Jul 09 01:17:42 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b Jul 09 01:17:42 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f95d7f-cfb8-44af-b8ad-d45fcac12cf6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:43 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 Jul 09 01:17:43 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:43 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:43 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 1G Jul 09 01:17:43 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:43 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:43 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839 Jul 09 01:17:43 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Acquiring lock "cinder-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "cinder-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Acquiring lock "cinder-quobyte-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "cinder-quobyte-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695869e-09e6-4771-9e61-0590e8cbb165]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:44 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 Jul 09 01:17:44 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:44 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 1G" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2b0959-95d6-4abd-846a-06d83d12e59b -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:44 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-6ba82fc8-05a3-449a-b074-c73aca3af839" returned: 0 in 0.698s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:44 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2b0959-95d6-4abd-846a-06d83d12e59b -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 Jul 09 01:17:44 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-6ba82fc8-05a3-449a-b074-c73aca3af839" released by "delete_volume" :: held 1.544s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['2a071fcd-eeda-4420-9889-1d5f68324bcf'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:44 devstack cinder-volume[86954]: WARNING cinder.quota [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1977947419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1977947419, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:17:44 devstack cinder-volume[86954]: WARNING cinder.quota [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1977947419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1977947419, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['d2373530-65bf-4494-9ff5-4306dd2f0fc7', 'd82cca24-9255-4f2d-8f8f-4607405f6b6c', '6f5315f7-2837-4a5d-ae88-eb6b482b53f9', 'e56a5641-4026-48f3-ae73-b59c781f720f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:44 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:44 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:44 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" returned: 0 in 0.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:44 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64 Jul 09 01:17:44 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:45 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2b0959-95d6-4abd-846a-06d83d12e59b -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:45 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 is being set with open permissions: ugo+rw Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:45 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 Jul 09 01:17:45 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: deleting Jul 09 01:17:45 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: deleting {{(pid=86954) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 01:17:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b9db297b-7a6b-4fde-bca2-193c1714bb3f tempest-GroupSnapshotsTest-1177914110 None] Delete group completed successfully. Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Deleting offline snapshot 3267506f-1bd8-4039-8a59-45fa0b5ce8bd of volume 72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] snapshot_file for this snap is: volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ae632-6dff-4064-8947-3dd9a97cc08c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:45 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" returned: 0 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "cinder-quobyte-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64" released by "delete_volume" :: held 1.580s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:45 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:45 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Created reservations ['927dd37c-b732-4722-8e44-502d70412579', 'f5b22e9e-be42-40b7-acf9-ed3d2a021190', '0610eb13-1064-47c6-955c-d3f161029b0d', '052429eb-1973-4ef3-a8d8-dce938e481a6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:45 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:45 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:45 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4" returned: 0 in 0.786s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:45 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info Jul 09 01:17:45 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:46 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.900s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d102bd-8fc2-4e86-bbba-03428b711256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ba926c-4220-4740-8503-89c6d7b5d99b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:46 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Deleted volume successfully. Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d766907-baa5-4cfa-80ff-7cd732914d1e tempest-ProjectReaderTests-1563814237 None] Lock "cinder-1a3bde42-a1eb-4b52-a50a-1d0133c9cc64-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:46 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info" returned: 0 in 0.734s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:46 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info is being set with open permissions: ugo+rw Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:46 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:46 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:46 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info Jul 09 01:17:46 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Flow 'volume_create_manager' (0d5a4d77-14b3-4a6b-bdcd-7d6190da249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16df870-1745-42dc-85de-70cf158857d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16df870-1745-42dc-85de-70cf158857d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090581662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98689ffc-0555-4c51-84a9-3c5c5e0b74f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe9afec3d414d86bc4bb842c56b5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:47Z,use_quota=True,user_id='153e8e6708e947b6af98dddcfd316900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a633381-2349-4dd7-84cd-832409a72cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a633381-2349-4dd7-84cd-832409a72cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64c5879-fde1-48e9-86be-5a7f27809f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64c5879-fde1-48e9-86be-5a7f27809f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98689ffc-0555-4c51-84a9-3c5c5e0b74f2', 'volume_name': 'volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c490be67-f84f-436a-b2c7-01b830828ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c490be67-f84f-436a-b2c7-01b830828ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d487ad7-516a-4d90-8555-fdb65ce19c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Volume 98689ffc-0555-4c51-84a9-3c5c5e0b74f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2', 'volume_size': 1} Jul 09 01:17:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:47 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:47 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.info" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.875s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.158s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1113648808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142cc91-bf55-4a9b-ba92-05c593425c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e857ee4aaf44b0a6f7b70aa367d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:37Z,use_quota=True,user_id='dc1117b0f0ab4068b214fb9e7053cf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Creating volume 9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:47 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:47 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 1073741824 Jul 09 01:17:47 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:47 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:47 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-81f1f3af-9726-402e-adb4-9071c57d71c7 req-820b7d12-aea6-4cf3-b0ea-d9a2ef8cb573 tempest-VolumesSnapshotsTestJSON-969593453 None] Create snapshot completed successfully Jul 09 01:17:48 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.753s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:48 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd Jul 09 01:17:48 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:48 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 1073741824" returned: 0 in 0.839s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:48 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:17:48 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "cinder-f48afb14-1293-459d-9a96-cb3eedd635e4-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-f48afb14-1293-459d-9a96-cb3eedd635e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "cinder-quobyte-f48afb14-1293-459d-9a96-cb3eedd635e4" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-f48afb14-1293-459d-9a96-cb3eedd635e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Deleting offline snapshot f48afb14-1293-459d-9a96-cb3eedd635e4 of volume 3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] snapshot_file for this snap is: volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed52c498-33a6-4b5f-b62e-58fa1cd52534]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:48 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 Jul 09 01:17:48 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:48 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256.3267506f-1bd8-4039-8a59-45fa0b5ce8bd" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3267506f-1bd8-4039-8a59-45fa0b5ce8bd" released by "_delete_snapshot" :: held 3.352s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" released by "delete_snapshot" :: held 3.392s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:48 devstack cinder-volume[86954]: WARNING cinder.quota [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1977947419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1977947419, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['0af53c62-66a2-4b85-a6de-e774206bc1d0', 'e8a5379a-5f10-4528-a9aa-d0721769210a', '63dc794d-05fa-48c8-85d3-1df99458d3f3', '11e300ec-955b-450f-8aec-7ace57e78bb3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:48 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090581662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98689ffc-0555-4c51-84a9-3c5c5e0b74f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe9afec3d414d86bc4bb842c56b5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:47Z,use_quota=True,user_id='153e8e6708e947b6af98dddcfd316900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Creating volume 98689ffc-0555-4c51-84a9-3c5c5e0b74f2 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:49 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1588ed7-dbda-45d2-981d-a50b9c49b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9142cc91-bf55-4a9b-ba92-05c593425c65', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:49 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 1073741824 Jul 09 01:17:49 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bf1609-0076-4c84-8ec8-b6d2b3f8d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Volume volume-9142cc91-bf55-4a9b-ba92-05c593425c65 (9142cc91-bf55-4a9b-ba92-05c593425c65): created successfully Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bf1609-0076-4c84-8ec8-b6d2b3f8d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (99e62e95-c4dc-497c-b578-f08e57de03db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-92e9e1c9-2f4e-4d5b-8f99-a20cd4feca42 tempest-VolumesDeleteCascade-912863999 None] Created volume successfully. Jul 09 01:17:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7a7bc119-2f69-42e1-813b-8df26e6b2d3b tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 757968b8-fa90-45a2-a7d1-c58b82b340e9: deleted successfully Jul 09 01:17:49 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4" returned: 0 in 0.814s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2b0959-95d6-4abd-846a-06d83d12e59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[453183cc-e43b-47be-b593-a55c43f592e7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:49 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b Jul 09 01:17:49 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:49 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 1073741824" returned: 0 in 0.842s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:49 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 Jul 09 01:17:49 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:50 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:50 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 Jul 09 01:17:50 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d67731-3c2e-41ea-aa78-c8754f590cc7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:50 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:50 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:50 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.540s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d487ad7-516a-4d90-8555-fdb65ce19c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f325c0-808e-42e4-9fad-e9b4f62e4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Creating offline snapshot 04a26c0d-a4be-440b-bc15-85625ab02a2e of volume 9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:17:50 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Volume volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 (98689ffc-0555-4c51-84a9-3c5c5e0b74f2): created successfully Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f325c0-808e-42e4-9fad-e9b4f62e4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Flow 'volume_create_manager' (0d5a4d77-14b3-4a6b-bdcd-7d6190da249a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[36100b52-913d-436f-83b1-44168afea4fb]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4a4a1318-6bcd-4b35-ba78-d6d928ee3a36 tempest-ProjectReaderTests-1563814237 None] Created volume successfully. Jul 09 01:17:50 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:17:50 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:51 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4" returned: 0 in 0.812s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:51 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4 Jul 09 01:17:51 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Acquiring lock "cinder-98689ffc-0555-4c51-84a9-3c5c5e0b74f2-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "cinder-98689ffc-0555-4c51-84a9-3c5c5e0b74f2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Acquiring lock "cinder-quobyte-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "cinder-quobyte-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c28964-5f21-485a-85d7-41f07c445ae3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:51 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.967s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:51 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256 Jul 09 01:17:51 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:51 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 Jul 09 01:17:51 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:51 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.963s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:51 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e 1G Jul 09 01:17:51 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:51 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b.f48afb14-1293-459d-9a96-cb3eedd635e4" returned: 0 in 0.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-f48afb14-1293-459d-9a96-cb3eedd635e4" released by "_delete_snapshot" :: held 3.400s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" released by "delete_snapshot" :: held 3.423s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:51 devstack cinder-volume[86954]: DEBUG cinder.quota [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Created reservations ['57bb7cf8-9291-4fe7-9320-841481d0e65b', '9c8e8052-c087-4e1e-ae88-658116151648', 'd3dc67b0-d852-40dd-a82c-a2d9625b1b97', '368459de-a8e0-4a48-b85e-d55eee5a6491'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:52 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-72d102bd-8fc2-4e86-bbba-03428b711256" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-72d102bd-8fc2-4e86-bbba-03428b711256" released by "delete_volume" :: held 1.806s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Delete snapshot completed successfully. Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-be9efc38-86ce-4b02-8e65-41e80280b57e req-18a5fc04-a384-4b33-b6c9-76293c0981fc tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-f48afb14-1293-459d-9a96-cb3eedd635e4-delete_snapshot" released by "delete_snapshot" :: held 3.633s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['44dd72b8-edfd-4725-af2f-3f230a8a0b64'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:52 devstack cinder-volume[86954]: WARNING cinder.db.api [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1977947419'] Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['b52bd544-ee52-4eaf-95bd-ef07c6951c62', 'b4236514-833c-4113-9d0f-c6050d702dd7', '504342ed-c87c-406a-8fa3-f7d5d4b7a032', 'd2210f37-a23e-4126-8dac-b74f3c4726f2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:52 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" returned: 0 in 0.937s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:52 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2 Jul 09 01:17:52 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:52 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:52 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:52 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e 1G" returned: 0 in 0.888s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:52 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:17:52 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:52 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "cinder-3e2b0959-95d6-4abd-846a-06d83d12e59b-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" returned: 0 in 0.789s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-3e2b0959-95d6-4abd-846a-06d83d12e59b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "cinder-quobyte-98689ffc-0555-4c51-84a9-3c5c5e0b74f2" released by "delete_volume" :: held 1.800s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:53 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f44ff39f-fca4-450f-b003-fa961b5d26a3 tempest-GroupSnapshotsTest-1177914110 None] Delete group completed successfully. Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" acquired by "delete_volume" :: waited 0.036s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b456a3-a527-4027-b929-ffbbf7c02760]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a181deb6-a3c3-48e5-8f81-50908fe19f67 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-1408066896: creating Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Created reservations ['38fe941e-cf2c-420e-bfac-57eb07e142d5', 'bc205a78-178b-4736-a2ae-5c1852f8f212', '2ee02e8b-3435-4e58-8146-e0afe29c2737', 'a38b691c-edf4-40b7-829c-b855471ef035'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a181deb6-a3c3-48e5-8f81-50908fe19f67 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-1408066896: created successfully Jul 09 01:17:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a181deb6-a3c3-48e5-8f81-50908fe19f67 tempest-GroupSnapshotsTest-1177914110 None] Create group completed successfully. Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:53 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b Jul 09 01:17:53 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:53 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:53 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:53 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.934s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:53 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e is being set with open permissions: ugo+rw Jul 09 01:17:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:53 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:17:53 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:54 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b" returned: 0 in 0.894s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:54 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.784s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:54 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b Jul 09 01:17:54 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Deleted volume successfully. Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9478dce2-604c-4270-90d3-b6aefc448f68 tempest-ProjectReaderTests-1563814237 None] Lock "cinder-98689ffc-0555-4c51-84a9-3c5c5e0b74f2-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:54 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:54 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info Jul 09 01:17:54 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:54 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3e2b0959-95d6-4abd-846a-06d83d12e59b" returned: 0 in 0.896s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-quobyte-3e2b0959-95d6-4abd-846a-06d83d12e59b" released by "delete_volume" :: held 1.885s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (86beb83f-cca4-4c10-8451-afa5ecc02634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c5ccbb-fbf7-4d4b-a05b-4928e7ca6d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c5ccbb-fbf7-4d4b-a05b-4928e7ca6d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71613836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,host='devstack@QuobyteHD#QuobyteHD',id=8d0d500a-2eb9-43d5-87d5-749be23db267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:55Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60cfca6-6c4a-4fe4-94e9-53471172a40c),volume_type_id=a60cfca6-6c4a-4fe4-94e9-53471172a40c)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ec768-eab8-4dde-b49e-3ed86a35e019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ec768-eab8-4dde-b49e-3ed86a35e019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b5bb2b-e210-418c-994a-8b9bf810489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b5bb2b-e210-418c-994a-8b9bf810489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0d500a-2eb9-43d5-87d5-749be23db267', 'volume_name': 'volume-8d0d500a-2eb9-43d5-87d5-749be23db267', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb8187-57dc-4258-93df-51d019a0eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beb8187-57dc-4258-93df-51d019a0eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc75ecd1-8684-4aae-8a5b-5b1142ced59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:55 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Volume 8d0d500a-2eb9-43d5-87d5-749be23db267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0d500a-2eb9-43d5-87d5-749be23db267', 'volume_size': 1} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.quota [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Created reservations ['f897de17-22fd-4bfb-919e-415eb707c2b0', '6e19edd0-05ef-49c9-ad4c-3fd3484988a1', '927f5bff-8292-47ee-8f56-df6d2ceb33df', '4c79d881-6278-4ead-898a-782c281c9cea'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:55 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:17:55 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:55 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info" returned: 0 in 0.997s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:55 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info is being set with open permissions: ugo+rw Jul 09 01:17:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:55 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info Jul 09 01:17:55 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:56 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.748s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.manager [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:17:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Deleted volume successfully. Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-aae9a485-f687-444b-ab52-8e1a3b6960f9 req-b16d5851-1a25-450f-b053-4c6f8826eb16 tempest-VolumesSnapshotsTestJSON-969593453 None] Lock "cinder-3e2b0959-95d6-4abd-846a-06d83d12e59b-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:17:56 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.info" returned: 0 in 0.783s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.528s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,created_at=2026-07-08T23:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71613836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,host='devstack@QuobyteHD#QuobyteHD',id=8d0d500a-2eb9-43d5-87d5-749be23db267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:55Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60cfca6-6c4a-4fe4-94e9-53471172a40c),volume_type_id=a60cfca6-6c4a-4fe4-94e9-53471172a40c)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Creating volume 8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:17:56 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:56 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 1073741824 Jul 09 01:17:56 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bb0582b3-bde4-49b7-b280-7945be532345 tempest-VolumesDeleteCascade-912863999 None] Create snapshot completed successfully Jul 09 01:17:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:17:57 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 1073741824" returned: 0 in 1.038s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:57 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 Jul 09 01:17:57 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:58 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267" returned: 0 in 0.755s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.399s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Creating offline snapshot 42edc18f-f6bb-446e-89ed-48b0ffe08c98 of volume 9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc75ecd1-8684-4aae-8a5b-5b1142ced59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0d500a-2eb9-43d5-87d5-749be23db267', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34316598-07d0-40cb-8002-58463194fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e7503-e317-46bb-b1f3-e0ff9a217382]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:58 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Volume volume-8d0d500a-2eb9-43d5-87d5-749be23db267 (8d0d500a-2eb9-43d5-87d5-749be23db267): created successfully Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34316598-07d0-40cb-8002-58463194fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:58 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (86beb83f-cca4-4c10-8451-afa5ecc02634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ed655f8a-5c96-4318-b0a0-6044eb8b5654 tempest-GroupSnapshotsTest-1177914110 None] Created volume successfully. Jul 09 01:17:58 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:17:58 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:59 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.981s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142cc91-bf55-4a9b-ba92-05c593425c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:17:59 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 1G Jul 09 01:17:59 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (830d8fa0-619e-4aaa-b206-3d8d6c21972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85a0030-6edf-4498-b7bc-82183e64725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85a0030-6edf-4498-b7bc-82183e64725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338892957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,host='devstack@QuobyteHD#QuobyteHD',id=2fb5242c-2776-4ca7-8dff-b621f1e2b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:59Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60cfca6-6c4a-4fe4-94e9-53471172a40c),volume_type_id=a60cfca6-6c4a-4fe4-94e9-53471172a40c)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232a5cbe-f510-49f2-8b3e-48819ac9a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232a5cbe-f510-49f2-8b3e-48819ac9a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742371c4-bbf2-4028-978b-cb9115ae4c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742371c4-bbf2-4028-978b-cb9115ae4c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb5242c-2776-4ca7-8dff-b621f1e2b3d0', 'volume_name': 'volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bcae01-7359-47db-bd24-9c5b2d4bd329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bcae01-7359-47db-bd24-9c5b2d4bd329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a957161a-4a6c-4541-810f-9e515867d8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:17:59 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Volume 2fb5242c-2776-4ca7-8dff-b621f1e2b3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0', 'volume_size': 1} Jul 09 01:17:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:00 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 1G" returned: 0 in 1.130s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:00 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:00 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:01 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:01 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 is being set with open permissions: ugo+rw Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:01 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:01 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:01 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.802s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,created_at=2026-07-08T23:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338892957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=222b2795-389b-41e0-81ec-ff8e0f9d6e9d,host='devstack@QuobyteHD#QuobyteHD',id=2fb5242c-2776-4ca7-8dff-b621f1e2b3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:17:59Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60cfca6-6c4a-4fe4-94e9-53471172a40c),volume_type_id=a60cfca6-6c4a-4fe4-94e9-53471172a40c)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Creating volume 2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:01 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:18:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:01 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 1073741824 Jul 09 01:18:01 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:01 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c9a3d7fa-d35a-4080-aa48-78175c14832b tempest-VolumesDeleteCascade-912863999 None] Create snapshot completed successfully Jul 09 01:18:02 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 1073741824" returned: 0 in 0.941s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:02 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 Jul 09 01:18:02 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-9142cc91-bf55-4a9b-ba92-05c593425c65-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-9142cc91-bf55-4a9b-ba92-05c593425c65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Performing cascade delete. {{(pid=86954) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-04a26c0d-a4be-440b-bc15-85625ab02a2e-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-04a26c0d-a4be-440b-bc15-85625ab02a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-04a26c0d-a4be-440b-bc15-85625ab02a2e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-04a26c0d-a4be-440b-bc15-85625ab02a2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Deleting offline snapshot 04a26c0d-a4be-440b-bc15-85625ab02a2e of volume 9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] snapshot_file for this snap is: volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0776d4dc-43ac-4477-9718-06bf48d57259]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:03 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:18:03 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:03 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" returned: 0 in 0.785s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a957161a-4a6c-4541-810f-9e515867d8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725ab866-6e52-4e2d-a4cd-3a3f3a657050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Volume volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 (2fb5242c-2776-4ca7-8dff-b621f1e2b3d0): created successfully Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725ab866-6e52-4e2d-a4cd-3a3f3a657050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (830d8fa0-619e-4aaa-b206-3d8d6c21972c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a04fa635-0780-4481-aa9c-b2ff4b2701cb tempest-GroupSnapshotsTest-1177914110 None] Created volume successfully. Jul 09 01:18:04 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.971s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142cc91-bf55-4a9b-ba92-05c593425c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317ed1f-a8a6-4355-9113-c6b5467f0a1d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:04 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:18:04 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1c6d43be-d663-4891-94ab-8f08b3af738f tempest-GroupSnapshotsTest-1177914110 None] Update group completed successfully. Jul 09 01:18:04 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=152,cinder:DELETE=14,cinder:SELECT=132,cinder:INSERT=35 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:18:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd6c6462-45fd-4950-bb11-65573f1fd00a tempest-GroupsV320Test-812401626 None] Group tempest-GroupsV320Test-Group-1140435396: creating Jul 09 01:18:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd6c6462-45fd-4950-bb11-65573f1fd00a tempest-GroupsV320Test-812401626 None] Group tempest-GroupsV320Test-Group-1140435396: created successfully Jul 09 01:18:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd6c6462-45fd-4950-bb11-65573f1fd00a tempest-GroupsV320Test-812401626 None] Create group completed successfully. Jul 09 01:18:05 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f899fab-b214-4832-a9c6-a2acbbaa5796]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:05 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:05 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:05 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=150,cinder:SELECT=128,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:18:05 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0d2b50ab-4b5f-43c9-aa82-34b6ac5ae691 tempest-GroupSnapshotsTest-1177914110 None] Update group completed successfully. Jul 09 01:18:06 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.797s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142cc91-bf55-4a9b-ba92-05c593425c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e7b750-6a00-4b40-b36f-7c8f7f5a12fe]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:06 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:18:06 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Created reservations ['465462af-f014-4466-927f-4d44253b3abf'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:06 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:06 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4568798f-ebef-430c-a4e4-03eb73943c1f tempest-GroupSnapshotsTest-1177914110 None] Update group completed successfully. Jul 09 01:18:06 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.911s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142cc91-bf55-4a9b-ba92-05c593425c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36b773-268b-4d20-86ef-557b56fe67d2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:07 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:18:07 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:07 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.716s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:07 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2e89c3ec-8612-4844-97de-ddb0404099e8 tempest-GroupsV320Test-812401626 None] Delete group completed successfully. Jul 09 01:18:07 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.997s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:08 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:18:08 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c813736f-be02-4496-9827-a6a386bcaea0 tempest-GroupSnapshotsTest-1177914110 None] Update group completed successfully. Jul 09 01:18:08 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.867s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:08 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e Jul 09 01:18:08 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] GroupSnapshot 92182b8c-d51f-467a-aac8-60cd628b8979: creating. Jul 09 01:18:09 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.04a26c0d-a4be-440b-bc15-85625ab02a2e" returned: 0 in 0.936s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 -F qcow2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:09 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 -F qcow2 Jul 09 01:18:09 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Group snapshot 92182b8c-d51f-467a-aac8-60cd628b8979: creating. {{(pid=86954) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Creating offline snapshot 3a1dacda-42d1-4eda-968f-110faf919041 of volume 8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e75ee-a580-4ade-aec6-2ab1f13a6205]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:10 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 Jul 09 01:18:10 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:10 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142cc91-bf55-4a9b-ba92-05c593425c65 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 -F qcow2" returned: 0 in 0.872s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-04a26c0d-a4be-440b-bc15-85625ab02a2e" released by "_delete_snapshot" :: held 7.511s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" released by "delete_snapshot" :: held 7.540s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Created reservations ['c0f94ff1-cfbd-4e67-bd0b-7b7d2d9e08fa', '8d826efd-dbc3-4368-9740-892f2a024858', '640d3276-3478-4123-ab8c-1f2f4fba26b4', 'ac42b193-bd30-43ba-8d61-5292f6bfed18'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:10 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267" returned: 0 in 0.972s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Delete snapshot completed successfully. Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-04a26c0d-a4be-440b-bc15-85625ab02a2e-delete_snapshot" released by "delete_snapshot" :: held 7.784s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-42edc18f-f6bb-446e-89ed-48b0ffe08c98-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:10 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 1G Jul 09 01:18:10 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-42edc18f-f6bb-446e-89ed-48b0ffe08c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-42edc18f-f6bb-446e-89ed-48b0ffe08c98" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-42edc18f-f6bb-446e-89ed-48b0ffe08c98" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Deleting offline snapshot 42edc18f-f6bb-446e-89ed-48b0ffe08c98 of volume 9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] snapshot_file for this snap is: volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1840c9e-fa59-4504-b624-e652f6e1b890]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:11 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:11 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:11 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.922s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142cc91-bf55-4a9b-ba92-05c593425c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c4535-450a-441c-8100-b523a8f340cf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:12 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 1G" returned: 0 in 1.163s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d500a-2eb9-43d5-87d5-749be23db267 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:12 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d500a-2eb9-43d5-87d5-749be23db267 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 Jul 09 01:18:12 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:12 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:18:12 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:12 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d500a-2eb9-43d5-87d5-749be23db267 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041" returned: 0 in 0.839s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:12 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:18:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:12 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 Jul 09 01:18:12 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:13 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 1.004s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:13 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:13 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:13 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041" returned: 0 in 0.908s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:13 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info Jul 09 01:18:13 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:13 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.926s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:14 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98 Jul 09 01:18:14 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Flow 'volume_create_manager' (f4990885-cdc3-4ff8-a6bc-e5b053a3b275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed97dd2-f2b0-4b32-aa17-2c014b3d43d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed97dd2-f2b0-4b32-aa17-2c014b3d43d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1280605577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b553a3d4f345f489da429f3a4d1e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:14Z,use_quota=True,user_id='43161a7ad9af43d09c3325f602c80539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59426ee-a63a-45ad-b80a-c3b31eca474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59426ee-a63a-45ad-b80a-c3b31eca474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f0a64-12a2-4ec8-9dd0-9e9d11ec5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f0a64-12a2-4ec8-9dd0-9e9d11ec5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58', 'volume_name': 'volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cb6de6-bac8-41a7-9dc5-5c9951a691ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cb6de6-bac8-41a7-9dc5-5c9951a691ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1028d38a-199d-4111-89ca-eded3dd02832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58', 'volume_size': 1} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:14 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:14 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:14 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info Jul 09 01:18:14 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:14 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65.42edc18f-f6bb-446e-89ed-48b0ffe08c98" returned: 0 in 0.847s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-42edc18f-f6bb-446e-89ed-48b0ffe08c98" released by "_delete_snapshot" :: held 3.824s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" released by "delete_snapshot" :: held 3.857s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:14 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Created reservations ['2ffbae4a-f305-48e3-906e-e8b1222cf8a2', '4fe2afb4-14b8-4c5c-9134-20bf96c3582d', '31678d4d-05fd-4f08-98ad-c7c54100fd11', 'cb289937-0781-489a-9a66-aa6bc0adaf35'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Delete snapshot completed successfully. Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-42edc18f-f6bb-446e-89ed-48b0ffe08c98-delete_snapshot" released by "delete_snapshot" :: held 4.042s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Snapshots deleted, issuing volume delete {{(pid=86954) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6e4b3b-2849-48c1-9f0f-9b76e55c8635]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:15 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:18:15 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:15 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.info" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.567s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Creating offline snapshot dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 of volume 2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b579b6-c70b-4f50-ad22-5a62089cf465]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:15 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 Jul 09 01:18:15 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:15 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:15 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65 Jul 09 01:18:15 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:16 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" returned: 0 in 0.851s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:16 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 1G Jul 09 01:18:16 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:16 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9142cc91-bf55-4a9b-ba92-05c593425c65" returned: 0 in 0.701s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9142cc91-bf55-4a9b-ba92-05c593425c65" released by "delete_volume" :: held 1.592s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Created reservations ['7309d7ae-a2fd-412b-a8e8-d470b04139c8', 'a6143123-04ea-4e2f-a6fa-713cf764327c', '9f66897d-7352-4d8b-a680-d103e1e38abc', '00610c6c-f7ff-4c5d-88d6-e84d6a16e412'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:16 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:16 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:17 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 1G" returned: 0 in 0.908s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:17 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 Jul 09 01:18:17 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:17 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.680s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Deleted volume successfully. Jul 09 01:18:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d68f8ef1-f7d3-4fd9-8022-904fb04bb678 tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-9142cc91-bf55-4a9b-ba92-05c593425c65-delete_volume" released by "delete_volume" :: held 14.462s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:18 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" returned: 0 in 0.816s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:18 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:18 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 Jul 09 01:18:18 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (87a6f6e2-673f-4045-9bf4-e57050fec15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61653ecc-d4b2-4148-bcf4-6770534c5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61653ecc-d4b2-4148-bcf4-6770534c5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-855719821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69207e24-a08a-4290-843a-f8c26146afed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e857ee4aaf44b0a6f7b70aa367d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:18Z,use_quota=True,user_id='dc1117b0f0ab4068b214fb9e7053cf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407248d8-7e2a-4bed-a4cb-f87c98055416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407248d8-7e2a-4bed-a4cb-f87c98055416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde5f49a-4a4b-4bbe-91d3-06da436c38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde5f49a-4a4b-4bbe-91d3-06da436c38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69207e24-a08a-4290-843a-f8c26146afed', 'volume_name': 'volume-69207e24-a08a-4290-843a-f8c26146afed', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed1140-302d-4680-a952-98f9023c8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed1140-302d-4680-a952-98f9023c8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1237d35-70d1-4e55-8ffe-5b48104871f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:18 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Volume 69207e24-a08a-4290-843a-f8c26146afed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69207e24-a08a-4290-843a-f8c26146afed', 'volume_size': 1} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:18 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" returned: 0 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:18 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info Jul 09 01:18:18 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:19 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info" returned: 0 in 0.674s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:19 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:18:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:19 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info Jul 09 01:18:19 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:20 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.info" returned: 0 in 0.801s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.876s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.697s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1280605577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b553a3d4f345f489da429f3a4d1e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:14Z,use_quota=True,user_id='43161a7ad9af43d09c3325f602c80539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Creating volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:20 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:18:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:20 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 1073741824 Jul 09 01:18:20 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-03d4dd08-7edf-46ad-ac4b-a8785a37259d tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 92182b8c-d51f-467a-aac8-60cd628b8979: created successfully Jul 09 01:18:21 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 1073741824" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:21 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 Jul 09 01:18:21 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 92182b8c-d51f-467a-aac8-60cd628b8979: deleting Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 92182b8c-d51f-467a-aac8-60cd628b8979: deleting {{(pid=86954) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-3a1dacda-42d1-4eda-968f-110faf919041" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3a1dacda-42d1-4eda-968f-110faf919041" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Deleting offline snapshot 3a1dacda-42d1-4eda-968f-110faf919041 of volume 8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] snapshot_file for this snap is: volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c237b16-fe2f-44f0-8b86-da2eb780a0bf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:21 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 Jul 09 01:18:21 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:22 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" returned: 0 in 0.801s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.775s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-855719821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69207e24-a08a-4290-843a-f8c26146afed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e857ee4aaf44b0a6f7b70aa367d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:18Z,use_quota=True,user_id='dc1117b0f0ab4068b214fb9e7053cf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Creating volume 69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:22 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1028d38a-199d-4111-89ca-eded3dd02832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:22 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed 1073741824 Jul 09 01:18:22 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e417e53-3123-4c2c-89b9-3497bf7a4d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Volume volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 (a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58): created successfully Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e417e53-3123-4c2c-89b9-3497bf7a4d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Flow 'volume_create_manager' (f4990885-cdc3-4ff8-a6bc-e5b053a3b275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fd9353e3-9dd0-4cd1-a9ef-7a755a35502d tempest-SnapshotsActionsTest-1500979108 None] Created volume successfully. Jul 09 01:18:22 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041" returned: 0 in 0.981s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d500a-2eb9-43d5-87d5-749be23db267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b700d-e755-4d8f-914d-8bde634b5ffb]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:22 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 Jul 09 01:18:22 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:23 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed 1073741824" returned: 0 in 1.058s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:23 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:23 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:23 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:23 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 Jul 09 01:18:23 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:23 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.742s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.362s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1237d35-70d1-4e55-8ffe-5b48104871f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69207e24-a08a-4290-843a-f8c26146afed', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd9bd13-2213-499d-b122-fcbed8174a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Creating offline snapshot 5a78e8d0-0891-4def-92bd-6bf62d17ee6e of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Volume volume-69207e24-a08a-4290-843a-f8c26146afed (69207e24-a08a-4290-843a-f8c26146afed): created successfully Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd9bd13-2213-499d-b122-fcbed8174a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (87a6f6e2-673f-4045-9bf4-e57050fec15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1912c4a-9945-4d42-9a85-88bcd70c45ac]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8ae879c0-cef9-4e2f-a1a2-e69bdcb54bf6 tempest-VolumesDeleteCascade-912863999 None] Created volume successfully. Jul 09 01:18:24 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 Jul 09 01:18:24 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:24 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:24 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041 Jul 09 01:18:24 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:24 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:24 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e 1G Jul 09 01:18:24 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:25 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267.3a1dacda-42d1-4eda-968f-110faf919041" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-3a1dacda-42d1-4eda-968f-110faf919041" released by "_delete_snapshot" :: held 3.620s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" released by "delete_snapshot" :: held 3.651s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Deleting offline snapshot dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 of volume 2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] snapshot_file for this snap is: volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb8f67-cb33-4673-a0e8-2b8accd1b688]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:25 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 Jul 09 01:18:25 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:25 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e 1G" returned: 0 in 1.034s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:25 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:25 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:26 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" returned: 0 in 1.101s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c4ccd-f8a2-4e77-8869-ec447e4b3234]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:26 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 Jul 09 01:18:26 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:26 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.858s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:26 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e is being set with open permissions: ugo+rw Jul 09 01:18:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:26 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:26 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Flow 'volume_create_manager' (f9b8b968-5106-4aa4-bdde-cb35c87803f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe949a4-a312-47fa-b361-66b5d6ae6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe949a4-a312-47fa-b361-66b5d6ae6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1662353809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551fdc91-f236-4f31-86c2-2369938e64d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160eada619674c56b5e3d243f832ade4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:27Z,use_quota=True,user_id='1a54d6a0238b4056852b15c49df001f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa09f63-b373-4266-9042-3d1795f681c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa09f63-b373-4266-9042-3d1795f681c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614caa62-d6e7-4c3e-a008-0de197ad2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614caa62-d6e7-4c3e-a008-0de197ad2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551fdc91-f236-4f31-86c2-2369938e64d1', 'volume_name': 'volume-551fdc91-f236-4f31-86c2-2369938e64d1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe2a403-1c04-455a-b421-9f0a00fbdcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe2a403-1c04-455a-b421-9f0a00fbdcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db38208a-34f3-4769-9be9-a5e04d19394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Volume 551fdc91-f236-4f31-86c2-2369938e64d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551fdc91-f236-4f31-86c2-2369938e64d1', 'volume_size': 1} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:27 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:27 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" returned: 0 in 0.833s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:27 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 Jul 09 01:18:27 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:27 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info Jul 09 01:18:27 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:28 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:28 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info is being set with open permissions: ugo+rw Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:28 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:28 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info Jul 09 01:18:28 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" returned: 0 in 0.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:28 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53 Jul 09 01:18:28 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:28 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.info" returned: 0 in 0.629s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.981s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Creating offline snapshot c11faeb8-eb92-4bbc-ad33-49abe7deb896 of volume 69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:28 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0.dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" returned: 0 in 0.661s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f2035-9a47-44e4-9636-8491a4192fe3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-917669e0-57ad-4a20-be76-5b2ed1a20d8b tempest-SnapshotsActionsTest-1500979108 None] Create snapshot completed successfully Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-dfa2aa26-fa1c-47bd-a1b1-ea6b0d154e53" released by "_delete_snapshot" :: held 3.447s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" released by "delete_snapshot" :: held 3.473s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:28 devstack cinder-volume[86954]: WARNING cinder.quota [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-837548880 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-837548880, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:18:28 devstack cinder-volume[86954]: WARNING cinder.quota [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-837548880 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-837548880, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:18:28 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:28 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:28 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['46594b5a-cea8-4309-90ea-44b8d31b13fc', '765ee673-98bc-4c0a-87e3-ea3aa6cf8b74', 'a7840cbf-d101-415e-a95f-ed8986343343', 'd6585679-245f-4a52-8b64-8b73d3ef4594'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['2085f405-9241-470e-a717-a53e0320637e', '8efabd36-5016-4d56-9c88-1e4988a1ce78', '23f1d266-121c-4d35-893a-7a7ce4b059ca', '7fdcf848-16ba-462f-98e6-a0bf8e2d3af0'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4498df97-a467-4ef6-ad67-232f2ab501e2 tempest-GroupSnapshotsTest-1177914110 None] group_snapshot 92182b8c-d51f-467a-aac8-60cd628b8979: deleted successfully Jul 09 01:18:29 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.807s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:29 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 1G Jul 09 01:18:29 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e2d310-f206-4053-a95b-c335d13f8236]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:29 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 Jul 09 01:18:29 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:30 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 1G" returned: 0 in 0.875s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69207e24-a08a-4290-843a-f8c26146afed -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:30 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69207e24-a08a-4290-843a-f8c26146afed -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:30 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:30 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:30 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0 Jul 09 01:18:30 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:31 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69207e24-a08a-4290-843a-f8c26146afed -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:31 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 is being set with open permissions: ugo+rw Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:31 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:31 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:31 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-2fb5242c-2776-4ca7-8dff-b621f1e2b3d0" released by "delete_volume" :: held 1.578s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b05dde-f8c1-4998-b737-23458d2bf2fc]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:31 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 Jul 09 01:18:31 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:31 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.729s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:32 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info Jul 09 01:18:32 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:32 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267" returned: 0 in 0.839s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:32 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267 Jul 09 01:18:32 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:32 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info" returned: 0 in 0.688s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:32 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info is being set with open permissions: ugo+rw Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:32 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info Jul 09 01:18:32 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:32 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8d0d500a-2eb9-43d5-87d5-749be23db267" returned: 0 in 0.653s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-8d0d500a-2eb9-43d5-87d5-749be23db267" released by "delete_volume" :: held 1.596s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:32 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['dd0dda76-0d73-4a06-b6b1-1017c647c964'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:33 devstack cinder-volume[86954]: WARNING cinder.quota [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-837548880 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-837548880, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['4b5a9c67-caba-451c-9ccb-14992e34d6b4', '50867a85-e4f4-4a5d-b43e-bfb5960fa316', '29087796-2ad0-4c57-8688-8e5a3b0152fd', 'a102be11-4b08-4a7a-a1df-4328bf24df70'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['82514dde-73fb-42e7-b4a9-b930648cc79b', 'b4681670-a330-4f56-b7bd-41f348f204a6', 'd9a8c617-dffa-48c2-a4eb-317e4ff2240e', '2711e1c5-087f-4e51-ad2b-36611242adc9'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:33 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:33 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:33 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.info" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.580s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.086s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1662353809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551fdc91-f236-4f31-86c2-2369938e64d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160eada619674c56b5e3d243f832ade4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:27Z,use_quota=True,user_id='1a54d6a0238b4056852b15c49df001f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Creating volume 551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:33 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:33 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 1073741824 Jul 09 01:18:33 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4f7ff523-0046-49b7-9a43-46ce992a7c94 tempest-VolumesDeleteCascade-912863999 None] Create snapshot completed successfully Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:33 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:33 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:33 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:33 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-24fa7646-222a-4d5f-9703-83fd0ed77dbb tempest-GroupSnapshotsTest-1177914110 None] Delete group completed successfully. Jul 09 01:18:34 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 1073741824" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:34 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:18:34 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:34 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:18:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:18:34 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.766s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.752s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-aa6493d7-75bd-4a56-a322-37d313e7d908 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-2116288984: creating Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Creating offline snapshot 80053319-72eb-4aae-a34c-ec00200cfe63 of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db38208a-34f3-4769-9be9-a5e04d19394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551fdc91-f236-4f31-86c2-2369938e64d1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9d9262-8fc5-4850-b2a2-8d36d3252408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (0d5d6f85-ea2a-4b6a-89f4-099e593d242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d799955-bdf8-4449-8bd8-0023a42f39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5241657-1c88-42e2-b96e-39b9f79b9342]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Volume volume-551fdc91-f236-4f31-86c2-2369938e64d1 (551fdc91-f236-4f31-86c2-2369938e64d1): created successfully Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9d9262-8fc5-4850-b2a2-8d36d3252408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Flow 'volume_create_manager' (f9b8b968-5106-4aa4-bdde-cb35c87803f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-aa6493d7-75bd-4a56-a322-37d313e7d908 tempest-GroupSnapshotsTest-1177914110 None] Group tempest-GroupSnapshotsTest-Group-2116288984: created successfully Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d799955-bdf8-4449-8bd8-0023a42f39a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-849701031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aaf0eb2-338e-4536-b30e-6f1a9f41b936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e857ee4aaf44b0a6f7b70aa367d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c11faeb8-eb92-4bbc-ad33-49abe7deb896,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:35Z,use_quota=True,user_id='dc1117b0f0ab4068b214fb9e7053cf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c515f73-7979-45ea-9944-211119e185eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c515f73-7979-45ea-9944-211119e185eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468cec07-fce9-4e80-848e-8eb060629250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468cec07-fce9-4e80-848e-8eb060629250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9aaf0eb2-338e-4536-b30e-6f1a9f41b936', 'volume_name': 'volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936', 'volume_size': 1, 'snapshot_id': 'c11faeb8-eb92-4bbc-ad33-49abe7deb896'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bf514d-a79c-45d4-94f2-92402a0aabf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bf514d-a79c-45d4-94f2-92402a0aabf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011e12bf-0120-4591-aec6-d866ec7f4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Volume 9aaf0eb2-338e-4536-b30e-6f1a9f41b936: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936', 'volume_size': 1, 'snapshot_id': 'c11faeb8-eb92-4bbc-ad33-49abe7deb896'} Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-81840b63-15f4-4818-9e84-e8dd43ab68f0 tempest-SnapshotDependencyTests-1355324132 None] Created volume successfully. Jul 09 01:18:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-aa6493d7-75bd-4a56-a322-37d313e7d908 tempest-GroupSnapshotsTest-1177914110 None] Create group completed successfully. Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:35 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:35 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:36 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.824s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:36 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 1G Jul 09 01:18:36 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (fcc77e0f-1583-4a2a-ae72-9665997b274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c239c9-2625-4c5d-a0fd-827d03e27172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c239c9-2625-4c5d-a0fd-827d03e27172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1688457554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f94f9f24-19f0-4aa9-bc50-ad1de241e165,host='devstack@QuobyteHD#QuobyteHD',id=883bbe8e-3a4c-48c1-a80d-971bf96a0854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:36Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bba076c7-d134-47b3-be8d-753ffb4c2594),volume_type_id=bba076c7-d134-47b3-be8d-753ffb4c2594)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903630d6-140b-4ddf-b8f4-cbb7dd4b8f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903630d6-140b-4ddf-b8f4-cbb7dd4b8f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c9b26c-450c-411e-b720-2f70b48761f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c9b26c-450c-411e-b720-2f70b48761f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883bbe8e-3a4c-48c1-a80d-971bf96a0854', 'volume_name': 'volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1775dfbd-643a-471f-9370-acd6d16c9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1775dfbd-643a-471f-9370-acd6d16c9735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d40be-991f-42a0-bffd-910a6a7c1783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Volume 883bbe8e-3a4c-48c1-a80d-971bf96a0854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854', 'volume_size': 1} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:36 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 1G" returned: 0 in 0.850s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:36 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 Jul 09 01:18:36 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:37 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:37 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 is being set with open permissions: ugo+rw Jul 09 01:18:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:37 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 Jul 09 01:18:37 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:38 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63" returned: 0 in 0.626s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.913s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Creating volume 9aaf0eb2-338e-4536-b30e-6f1a9f41b936 from snapshot c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-966791f5-8b52-47a1-aaeb-405ab2b3375c tempest-SnapshotsActionsTest-1500979108 None] Create snapshot completed successfully Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] snapshot: c11faeb8-eb92-4bbc-ad33-49abe7deb896, volume: 9aaf0eb2-338e-4536-b30e-6f1a9f41b936, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70416328-d2e2-42da-aed5-3d5d6f7d37e4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:38 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:38 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-80053319-72eb-4aae-a34c-ec00200cfe63-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-80053319-72eb-4aae-a34c-ec00200cfe63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-80053319-72eb-4aae-a34c-ec00200cfe63" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-80053319-72eb-4aae-a34c-ec00200cfe63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Deleting offline snapshot 80053319-72eb-4aae-a34c-ec00200cfe63 of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] snapshot_file for this snap is: volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad2591-6c3a-445a-af33-d98b9c544e60]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:39 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 Jul 09 01:18:39 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:39 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.784s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69207e24-a08a-4290-843a-f8c26146afed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b65e4-c140-4989-bc74-24155c81f031]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:39 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:39 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:39 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63" returned: 0 in 0.760s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[76663414-48a6-45b4-ad79-5e964b88615a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:39 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:39 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:39 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:18:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:39 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 Jul 09 01:18:39 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:40 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:40 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 Jul 09 01:18:40 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:41 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63" returned: 0 in 1.403s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:41 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63 Jul 09 01:18:41 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:43 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.80053319-72eb-4aae-a34c-ec00200cfe63" returned: 0 in 1.154s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-80053319-72eb-4aae-a34c-ec00200cfe63" released by "_delete_snapshot" :: held 4.196s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_snapshot" :: held 4.236s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:43 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Created reservations ['fd9b3845-a495-414f-833f-1c1e5e9d4653', 'fd4bec71-a930-4c99-9217-85657916cb4e', '4e06e86a-fb3e-409b-b3ba-a6b1d0f5e07c', '921c9fac-90dc-4f87-92c0-2021e4183849'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Delete snapshot completed successfully. Jul 09 01:18:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-86837dbb-161e-4dc2-824f-d9932acabb59 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-80053319-72eb-4aae-a34c-ec00200cfe63-delete_snapshot" released by "delete_snapshot" :: held 4.634s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:44 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" returned: 0 in 5.096s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bac9e-3ca6-4b23-afef-671c11fbd3a9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:45 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:45 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:45 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:18:45 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Converted 1024.00 MB image at 200.91 MB/s Jul 09 01:18:45 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 is being set with open permissions: ugo+rw Jul 09 01:18:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:45 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 Jul 09 01:18:45 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:46 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" returned: 0 in 0.637s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" released by "_copy_volume_from_snapshot" :: held 8.273s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" released by "_create_volume_from_snapshot" :: held 8.310s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.328s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.606s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Creating offline snapshot 9b05c810-d4f8-4887-9b93-b77f42cb1f76 of volume 551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011e12bf-0120-4591-aec6-d866ec7f4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936', 'volume_size': 1, 'snapshot_id': 'c11faeb8-eb92-4bbc-ad33-49abe7deb896'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5381a11e-f3a9-4c14-8ae3-4f185df6f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb8d1aa-67c0-4e8d-afbd-2b61e15cb6d3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Volume volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 (9aaf0eb2-338e-4536-b30e-6f1a9f41b936): created successfully Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5381a11e-f3a9-4c14-8ae3-4f185df6f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Flow 'volume_create_manager' (0d5d6f85-ea2a-4b6a-89f4-099e593d242a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-037fcad6-7be5-4e1d-aeac-6d6d121f73be tempest-VolumesDeleteCascade-912863999 None] Created volume successfully. Jul 09 01:18:46 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:18:46 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-69207e24-a08a-4290-843a-f8c26146afed-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-69207e24-a08a-4290-843a-f8c26146afed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Performing cascade delete. {{(pid=86954) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-c11faeb8-eb92-4bbc-ad33-49abe7deb896-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-c11faeb8-eb92-4bbc-ad33-49abe7deb896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Deleting offline snapshot c11faeb8-eb92-4bbc-ad33-49abe7deb896 of volume 69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] snapshot_file for this snap is: volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb950f-d413-45cb-94ad-73987c1e5a6b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:47 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:47 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:47 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.769s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:47 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 1G Jul 09 01:18:47 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:47 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.792s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69207e24-a08a-4290-843a-f8c26146afed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411338e-2037-49ee-82cd-11d665d30ef1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:48 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:48 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:48 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 1G" returned: 0 in 0.824s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551fdc91-f236-4f31-86c2-2369938e64d1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:48 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551fdc91-f236-4f31-86c2-2369938e64d1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:18:48 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:48 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.771s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:48 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:48 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:48 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551fdc91-f236-4f31-86c2-2369938e64d1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.699s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:48 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 is being set with open permissions: ugo+rw Jul 09 01:18:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:48 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:18:48 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:49 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.729s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:49 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896 Jul 09 01:18:49 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:49 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.650s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:49 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info Jul 09 01:18:49 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:50 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed.c11faeb8-eb92-4bbc-ad33-49abe7deb896" returned: 0 in 0.668s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-c11faeb8-eb92-4bbc-ad33-49abe7deb896" released by "_delete_snapshot" :: held 3.042s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" released by "delete_snapshot" :: held 3.065s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Created reservations ['7ec86e87-7918-46c0-a576-9accb25a7a80', 'f3d27948-5ce8-4131-ade4-d1b8a10aeab6', '8e8b4cf5-b58b-4120-8ee9-f09fe0c78849', '4b157881-c985-4bd1-8cbc-2a42cf09f315'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Delete snapshot completed successfully. Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-c11faeb8-eb92-4bbc-ad33-49abe7deb896-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Snapshots deleted, issuing volume delete {{(pid=86954) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:50 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:50 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info is being set with open permissions: ugo+rw Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:50 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info Jul 09 01:18:50 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa679aa-57c0-4847-9e4a-9fa29136b8d2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:50 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:50 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:50 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.info" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.375s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.359s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f94f9f24-19f0-4aa9-bc50-ad1de241e165,created_at=2026-07-08T23:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1688457554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f94f9f24-19f0-4aa9-bc50-ad1de241e165,host='devstack@QuobyteHD#QuobyteHD',id=883bbe8e-3a4c-48c1-a80d-971bf96a0854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c0f1e13eb4b6a98ab3a99d4dc1e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:36Z,use_quota=True,user_id='d6ff1682dab74cd19ea3ba1059a3adb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bba076c7-d134-47b3-be8d-753ffb4c2594),volume_type_id=bba076c7-d134-47b3-be8d-753ffb4c2594)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Creating volume 883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:50 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:18:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:50 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 1073741824 Jul 09 01:18:51 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-73fbc247-2271-4b34-a73e-b2f5f95b6443 tempest-SnapshotDependencyTests-1355324132 None] Create snapshot completed successfully Jul 09 01:18:51 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.765s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:51 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed Jul 09 01:18:51 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:51 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69207e24-a08a-4290-843a-f8c26146afed" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-69207e24-a08a-4290-843a-f8c26146afed" released by "delete_volume" :: held 1.492s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Created reservations ['f90791f7-47bf-4341-8a7a-a1d5d7c7d82d', '349dbdb5-778e-434c-a5e6-88299f1b0ed1', '0bf7e3d6-45e8-4e43-99de-64703dcb89b9', '1cbd6390-d2bd-4f58-82aa-1afb4056d7a7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:51 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 1073741824" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:51 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:51 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:51 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 Jul 09 01:18:51 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Flow 'volume_create_manager' (bde268f2-dc8f-4864-98de-01d717a38abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544ebd8-2c9f-4668-a226-45b27dd41111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544ebd8-2c9f-4668-a226-45b27dd41111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54baee0-a8ec-4fa5-8666-d92569df3612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160eada619674c56b5e3d243f832ade4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b05c810-d4f8-4887-9b93-b77f42cb1f76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:18:52Z,use_quota=True,user_id='1a54d6a0238b4056852b15c49df001f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a592c-9cb8-4897-aee9-699e6e5b5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a592c-9cb8-4897-aee9-699e6e5b5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b75bc1f-352c-4487-ad58-2d155b8a8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b75bc1f-352c-4487-ad58-2d155b8a8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a54baee0-a8ec-4fa5-8666-d92569df3612', 'volume_name': 'volume-a54baee0-a8ec-4fa5-8666-d92569df3612', 'volume_size': 1, 'snapshot_id': '9b05c810-d4f8-4887-9b93-b77f42cb1f76'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab88e8a7-9384-4ffe-8672-4c5c560e7370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab88e8a7-9384-4ffe-8672-4c5c560e7370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79303e13-fafa-4d35-8f0f-37c3d655e250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Volume a54baee0-a8ec-4fa5-8666-d92569df3612: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a54baee0-a8ec-4fa5-8666-d92569df3612', 'volume_size': 1, 'snapshot_id': '9b05c810-d4f8-4887-9b93-b77f42cb1f76'} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-9aaf0eb2-338e-4536-b30e-6f1a9f41b936-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-9aaf0eb2-338e-4536-b30e-6f1a9f41b936-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:52 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.757s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Deleted volume successfully. Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4fd1de-9e10-4a16-b227-374b53e216ba]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f12db836-8b2f-4646-a9bd-c93db5e7127b tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-69207e24-a08a-4290-843a-f8c26146afed-delete_volume" released by "delete_volume" :: held 5.748s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:52 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.979s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d40be-991f-42a0-bffd-910a6a7c1783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cf1fb3-9390-4d37-be2e-7c78154fe929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:18:52 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Creating offline snapshot 77e4dbf4-7af9-4341-9a3e-688dddf0407d of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:18:52 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Volume volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 (883bbe8e-3a4c-48c1-a80d-971bf96a0854): created successfully Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cf1fb3-9390-4d37-be2e-7c78154fe929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Flow 'volume_create_manager' (fcc77e0f-1583-4a2a-ae72-9665997b274f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2671d-dce8-404e-80bf-72e0c992a590]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-80b652bb-fa5b-4f0b-aeae-169aaf2a1791 tempest-GroupSnapshotsTest-1177914110 None] Created volume successfully. Jul 09 01:18:52 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:52 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:53 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" returned: 0 in 0.795s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:53 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936 Jul 09 01:18:53 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] GroupSnapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: creating. Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Group snapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: creating. {{(pid=86954) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:53 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.825s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:53 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d 1G Jul 09 01:18:53 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:54 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-quobyte-9aaf0eb2-338e-4536-b30e-6f1a9f41b936" released by "delete_volume" :: held 1.514s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Created reservations ['d69ae55f-3cfa-44a2-89d2-80a81cea94b8', '870ffde3-fa78-41c8-9829-f5c53c4b25df', '957dbd75-5e38-40a8-9107-9137f7becbf0', '1d3f3e70-f679-447f-abd3-0a56cdcbf0eb'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:54 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:18:54 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:54 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d 1G" returned: 0 in 0.870s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:54 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d Jul 09 01:18:54 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:54 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.686s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:54 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:18:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Deleted volume successfully. Jul 09 01:18:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4751882e-80a5-4c26-a554-266b001f6e6e tempest-VolumesDeleteCascade-912863999 None] Lock "cinder-9aaf0eb2-338e-4536-b30e-6f1a9f41b936-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:18:55 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d" returned: 0 in 0.793s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:55 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d is being set with open permissions: ugo+rw Jul 09 01:18:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:55 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d Jul 09 01:18:55 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:56 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.294s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.507s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76-a54baee0-a8ec-4fa5-8666-d92569df3612" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76-a54baee0-a8ec-4fa5-8666-d92569df3612" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Creating volume a54baee0-a8ec-4fa5-8666-d92569df3612 from snapshot 9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c6fe2148-42b1-4f90-9ee1-44fe29f83476 tempest-SnapshotsActionsTest-1500979108 None] Create snapshot completed successfully Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] snapshot: 9b05c810-d4f8-4887-9b93-b77f42cb1f76, volume: a54baee0-a8ec-4fa5-8666-d92569df3612, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d470877-4423-40d0-bb19-ab812081feba]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:56 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:18:56 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:56 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.804s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-551fdc91-f236-4f31-86c2-2369938e64d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:18:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f819f62-f4f5-4166-b0e8-642058a6874d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:57 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:18:57 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-77e4dbf4-7af9-4341-9a3e-688dddf0407d-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-77e4dbf4-7af9-4341-9a3e-688dddf0407d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-77e4dbf4-7af9-4341-9a3e-688dddf0407d" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-77e4dbf4-7af9-4341-9a3e-688dddf0407d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Deleting offline snapshot 77e4dbf4-7af9-4341-9a3e-688dddf0407d of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] snapshot_file for this snap is: volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d21e05-b327-48f2-87a5-3fd6d574bb1f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:57 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d Jul 09 01:18:57 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:57 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:18:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:57 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 Jul 09 01:18:57 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:58 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d" returned: 0 in 0.903s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054b6d1-d82b-40a5-9551-2bfeb2ac0907]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:18:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:58 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:18:58 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:18:59 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 09 01:18:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 1.216s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:18:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:18:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:18:59 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d Jul 09 01:18:59 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:01 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d" returned: 0 in 1.892s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:01 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d Jul 09 01:19:01 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:02 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.77e4dbf4-7af9-4341-9a3e-688dddf0407d" returned: 0 in 0.991s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-77e4dbf4-7af9-4341-9a3e-688dddf0407d" released by "_delete_snapshot" :: held 5.190s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_snapshot" :: held 5.226s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:02 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Created reservations ['48eed455-5609-4604-9b6c-f2e5f420d87b', '4e498db0-4df1-4934-91de-2f4b96a792b1', 'd2d29227-ed20-48c6-966d-e8f4d7679302', '9840b7c4-16b3-4d21-bb2e-13f409ae58b4'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Delete snapshot completed successfully. Jul 09 01:19:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-43e526b6-7b84-4c5f-bed9-e187de3f360b tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-77e4dbf4-7af9-4341-9a3e-688dddf0407d-delete_snapshot" released by "delete_snapshot" :: held 5.571s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:03 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612" returned: 0 in 5.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d1eae3-3602-487a-a1a5-7f758a150073]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:03 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:19:03 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:04 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.984s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:04 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:19:04 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Converted 1024.00 MB image at 176.34 MB/s Jul 09 01:19:04 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 is being set with open permissions: ugo+rw Jul 09 01:19:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:04 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 Jul 09 01:19:04 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:05 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" released by "_copy_volume_from_snapshot" :: held 9.293s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76-a54baee0-a8ec-4fa5-8666-d92569df3612" released by "_create_volume_from_snapshot" :: held 9.341s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.377s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.887s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=123,cinder:UPDATE=115,cinder:INSERT=29,cinder:DELETE=5 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Creating offline snapshot 7e2545cb-6cd9-442f-98cc-e21b79674905 of volume 883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79303e13-fafa-4d35-8f0f-37c3d655e250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54baee0-a8ec-4fa5-8666-d92569df3612', 'volume_size': 1, 'snapshot_id': '9b05c810-d4f8-4887-9b93-b77f42cb1f76'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc54c5d-9241-4547-979d-423435d4a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb453a-d189-45a6-8f51-6268000fc6b6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:05 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Volume volume-a54baee0-a8ec-4fa5-8666-d92569df3612 (a54baee0-a8ec-4fa5-8666-d92569df3612): created successfully Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc54c5d-9241-4547-979d-423435d4a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Flow 'volume_create_manager' (bde268f2-dc8f-4864-98de-01d717a38abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:05 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-70bac477-1c1b-437f-b95b-c9321fcee2ca tempest-SnapshotDependencyTests-1355324132 None] Created volume successfully. Jul 09 01:19:05 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 Jul 09 01:19:05 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:06 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:06 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 1G Jul 09 01:19:06 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-9b05c810-d4f8-4887-9b93-b77f42cb1f76-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-9b05c810-d4f8-4887-9b93-b77f42cb1f76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Deleting offline snapshot 9b05c810-d4f8-4887-9b93-b77f42cb1f76 of volume 551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] snapshot_file for this snap is: volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7409a52c-6648-46d1-9693-b77dd2b5598a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:06 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:19:06 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:07 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 1G" returned: 0 in 0.834s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:07 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 Jul 09 01:19:07 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:07 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.807s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-551fdc91-f236-4f31-86c2-2369938e64d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa5796-0f9e-4e5c-acf0-4b44e7c4565c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:07 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:19:07 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:07 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905" returned: 0 in 0.736s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:07 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:19:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:07 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 Jul 09 01:19:07 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:08 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.826s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:08 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:19:08 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:08 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905" returned: 0 in 0.725s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:08 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=107,cinder:INSERT=30,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:19:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:08 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info Jul 09 01:19:08 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:09 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.838s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:09 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76 Jul 09 01:19:09 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:09 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info" returned: 0 in 0.777s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:09 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 01:19:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:09 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info Jul 09 01:19:09 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:10 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1.9b05c810-d4f8-4887-9b93-b77f42cb1f76" returned: 0 in 0.719s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-9b05c810-d4f8-4887-9b93-b77f42cb1f76" released by "_delete_snapshot" :: held 3.329s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" released by "delete_snapshot" :: held 3.351s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:10 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.info" returned: 0 in 0.683s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.930s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Creating offline snapshot 0c93abd5-73bf-4e8a-8356-9368266e271e of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db364d-9e16-4648-b4d8-a41fe5fee7de]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Created reservations ['e03ca5f2-cf1d-40fd-967f-ceea545e4c78', 'bb2e6e43-1d2e-49fa-aebc-2bdb37cfdfb5', 'ae04211d-2996-4b3e-842f-959bef069d4a', '920a7e54-ff78-4742-967c-f01da0d16305'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:10 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:10 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-500a6119-78da-4b7f-8eee-9071ce2efb97 tempest-GroupSnapshotsTest-1177914110 None] group_snapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: created successfully Jul 09 01:19:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Delete snapshot completed successfully. Jul 09 01:19:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c6a23a2-abd8-4be1-a363-7bbdbb6c507f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-9b05c810-d4f8-4887-9b93-b77f42cb1f76-delete_snapshot" released by "delete_snapshot" :: held 3.928s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] group_snapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: deleting Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] group_snapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: deleting {{(pid=86954) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-7e2545cb-6cd9-442f-98cc-e21b79674905" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-7e2545cb-6cd9-442f-98cc-e21b79674905" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Deleting offline snapshot 7e2545cb-6cd9-442f-98cc-e21b79674905 of volume 883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] snapshot_file for this snap is: volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a434e-01c3-4942-863d-1ae9195aa6c4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:11 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-551fdc91-f236-4f31-86c2-2369938e64d1-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.980s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-551fdc91-f236-4f31-86c2-2369938e64d1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:11 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e 1G Jul 09 01:19:11 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:11 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 Jul 09 01:19:11 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1f5a9-2bed-4b00-baa9-fb625f0b2412]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:11 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:19:11 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:12 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905" returned: 0 in 0.978s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b6ef1-e12d-4718-9379-e492c420ddb3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:12 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e 1G" returned: 0 in 1.037s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:12 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 Jul 09 01:19:12 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:12 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e Jul 09 01:19:12 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:12 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 1.033s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:12 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1 Jul 09 01:19:12 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Flow 'volume_create_manager' (4fcf9379-98ce-4a40-b2ad-7fd5139b49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b866cb52-be90-4ef6-a7fb-477caab95331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b866cb52-be90-4ef6-a7fb-477caab95331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739772672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35e0dbd-7eb0-4c6d-b000-167129d5bc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac329235a34c03a500f975204dc3aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:13Z,use_quota=True,user_id='10d3c0b2603248c7908080b83f6111da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfdb83-96ea-4709-86ae-f45a2bbd959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfdb83-96ea-4709-86ae-f45a2bbd959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde0bc08-9c33-418d-bd08-37fca928d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde0bc08-9c33-418d-bd08-37fca928d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35e0dbd-7eb0-4c6d-b000-167129d5bc96', 'volume_name': 'volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2565f5-1632-49ee-9352-fada3b46278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2565f5-1632-49ee-9352-fada3b46278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f90a86-8853-44e0-9e92-09aa749b229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96', 'volume_size': 1} Jul 09 01:19:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:13 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854" returned: 0 in 0.870s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 Jul 09 01:19:13 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:13 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:13 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e is being set with open permissions: ugo+rw Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e Jul 09 01:19:13 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:13 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-551fdc91-f236-4f31-86c2-2369938e64d1" returned: 0 in 0.766s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-551fdc91-f236-4f31-86c2-2369938e64d1" released by "delete_volume" :: held 1.867s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Created reservations ['4bc490e6-7ff4-4186-b1e6-f0624eb3ccfc', 'eaa04f8c-eb4a-49f4-9bc3-4c87da3fd4f1', '64f40bb0-e11f-414e-9c65-3b91e8f1b0af', 'b17e89bf-78a9-45e5-9da6-6c9f922c3d79'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:13 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-a54baee0-a8ec-4fa5-8666-d92569df3612-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-a54baee0-a8ec-4fa5-8666-d92569df3612-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b011602-4cb7-4cfb-87a6-47bee42f3635]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e" returned: 0 in 0.706s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:13 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 Jul 09 01:19:13 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.676s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739772672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35e0dbd-7eb0-4c6d-b000-167129d5bc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac329235a34c03a500f975204dc3aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:13Z,use_quota=True,user_id='10d3c0b2603248c7908080b83f6111da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Creating volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:19:13 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905" returned: 0 in 0.860s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:13 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 1073741824 Jul 09 01:19:13 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-224669e8-82b9-4a5d-bba6-4e5dab981a12 tempest-SnapshotsActionsTest-1500979108 None] Create snapshot completed successfully Jul 09 01:19:13 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905 Jul 09 01:19:13 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:14 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Deleted volume successfully. Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f91a0697-dcc2-4bce-b782-3052c07a87be tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-551fdc91-f236-4f31-86c2-2369938e64d1-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:14 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:14 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854.7e2545cb-6cd9-442f-98cc-e21b79674905" returned: 0 in 0.690s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:14 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612 Jul 09 01:19:14 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-7e2545cb-6cd9-442f-98cc-e21b79674905" released by "_delete_snapshot" :: held 3.554s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" released by "delete_snapshot" :: held 3.604s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:14 devstack cinder-volume[86954]: WARNING cinder.quota [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-347742594 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-347742594, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:19:14 devstack cinder-volume[86954]: WARNING cinder.quota [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-347742594 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-347742594, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['b5744a3f-0f80-4016-8c15-226caa86e52b', 'eea99c30-fefb-421e-9bc9-ef590c6c567b', '5a854aa0-eb27-4c7d-9f9d-371e976579aa', '3a3cb809-72f5-44db-83f1-e412320c6e1e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-736c60a8-5031-490a-bd6b-bfbb9da828ab tempest-GroupSnapshotsTest-1177914110 None] group_snapshot f53a5c02-52b1-4d73-83ee-3341529b0c31: deleted successfully Jul 09 01:19:14 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 1073741824" returned: 0 in 0.996s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:14 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:19:14 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-0c93abd5-73bf-4e8a-8356-9368266e271e-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-0c93abd5-73bf-4e8a-8356-9368266e271e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-0c93abd5-73bf-4e8a-8356-9368266e271e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-0c93abd5-73bf-4e8a-8356-9368266e271e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Deleting offline snapshot 0c93abd5-73bf-4e8a-8356-9368266e271e of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] snapshot_file for this snap is: volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f158dc-2c2c-49bc-8e1b-8054840bd985]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:15 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e Jul 09 01:19:15 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:15 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a54baee0-a8ec-4fa5-8666-d92569df3612" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-quobyte-a54baee0-a8ec-4fa5-8666-d92569df3612" released by "delete_volume" :: held 1.641s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Created reservations ['c95cd130-2f66-47e3-a76f-3ec988d75250', 'a6567cfb-4c02-4f31-a120-922a74b054c7', 'b979e54a-f708-4884-a132-3f07e8b6260f', '8cbcf16d-0d38-4ed6-928a-aaefc54b1b68'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:15 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:15 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:15 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.687s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f90a86-8853-44e0-9e92-09aa749b229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915c719e-2387-4548-bea9-7ce0ece160d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:15 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Volume volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 (e35e0dbd-7eb0-4c6d-b000-167129d5bc96): created successfully Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915c719e-2387-4548-bea9-7ce0ece160d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Flow 'volume_create_manager' (4fcf9379-98ce-4a40-b2ad-7fd5139b49b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f0196c49-72a8-4254-b283-6e4fce48cbd5 tempest-VolumesActionsTest-940477369 None] Created volume successfully. Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b9f7b-373a-4b19-8fb0-22227d0ded6c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:16 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e" returned: 0 in 0.965s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[181a9169-b55d-49c5-bba1-fcb8c981581a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:16 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 Jul 09 01:19:16 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:16 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:16 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:16 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.851s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Deleted volume successfully. Jul 09 01:19:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ef4cd01f-1bbe-4f5d-9e2a-5f4effe4725f tempest-SnapshotDependencyTests-1355324132 None] Lock "cinder-a54baee0-a8ec-4fa5-8666-d92569df3612-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:17 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854" returned: 0 in 1.083s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:17 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854 Jul 09 01:19:17 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:17 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 1.171s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:17 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e Jul 09 01:19:17 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:17 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-883bbe8e-3a4c-48c1-a80d-971bf96a0854" returned: 0 in 0.883s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Lock "cinder-quobyte-883bbe8e-3a4c-48c1-a80d-971bf96a0854" released by "delete_volume" :: held 2.070s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['6baf897c-d4c3-4a10-b916-31d84c83a1ce'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:18 devstack cinder-volume[86954]: WARNING cinder.quota [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-347742594 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-347742594, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Created reservations ['019ace0e-13ee-4449-9555-961db8bfc6cf', 'a7fb08b3-408c-4571-8d49-9d2586ed2050', 'f063c73c-e0b7-42f2-b1f4-acb737b3c867', '3071fcbc-fe3c-4bd1-baa0-46d4727522cf'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:18 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:18 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:18 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e" returned: 0 in 1.177s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:18 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e Jul 09 01:19:18 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:19 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.979s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1a634a11-1f4a-4103-9df0-971436c6f7a5 tempest-GroupSnapshotsTest-1177914110 None] Delete group completed successfully. Jul 09 01:19:19 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.0c93abd5-73bf-4e8a-8356-9368266e271e" returned: 0 in 0.972s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-0c93abd5-73bf-4e8a-8356-9368266e271e" released by "_delete_snapshot" :: held 4.465s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_snapshot" :: held 4.498s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Created reservations ['86d30652-a79a-4a53-9eae-979fded3035f', '86c50485-e384-4ece-99c0-47f31c066e8d', '8b61f1c2-4f33-41e2-8153-61b73fe3a6a5', '53b70c9c-572a-4759-b5ac-974e99771f46'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Delete snapshot completed successfully. Jul 09 01:19:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b0a9f568-61ab-4e39-b4c5-4ed224310447 tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-0c93abd5-73bf-4e8a-8356-9368266e271e-delete_snapshot" released by "delete_snapshot" :: held 4.727s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Creating offline snapshot fb11418b-0764-4c38-8a1b-58a265d4c358 of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:19:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed57f2-a3c0-4d95-b77c-6fce5ec7f5a5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:21 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:21 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:21 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.921s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:21 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 1G Jul 09 01:19:21 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:22 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 1G" returned: 0 in 0.954s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:22 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 Jul 09 01:19:22 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:23 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358" returned: 0 in 0.827s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:23 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 is being set with open permissions: ugo+rw Jul 09 01:19:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:23 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 Jul 09 01:19:23 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:24 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358" returned: 0 in 0.985s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.812s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a8ea65f8-565c-4835-a39d-3ae2d965eb92 tempest-SnapshotsActionsTest-1500979108 None] Create snapshot completed successfully Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-fb11418b-0764-4c38-8a1b-58a265d4c358-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-fb11418b-0764-4c38-8a1b-58a265d4c358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Acquiring lock "cinder-quobyte-fb11418b-0764-4c38-8a1b-58a265d4c358" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-fb11418b-0764-4c38-8a1b-58a265d4c358" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Deleting offline snapshot fb11418b-0764-4c38-8a1b-58a265d4c358 of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] snapshot_file for this snap is: volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119d908-ee16-4890-ace0-052b755f6346]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:25 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 Jul 09 01:19:25 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:26 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358" returned: 0 in 1.064s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1863f735-9fc6-4578-aa08-0211bd6e6702]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:26 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:26 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:27 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 1.054s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:27 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 Jul 09 01:19:27 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:28 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358" returned: 0 in 0.904s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:28 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358 Jul 09 01:19:28 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:29 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.fb11418b-0764-4c38-8a1b-58a265d4c358" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-fb11418b-0764-4c38-8a1b-58a265d4c358" released by "_delete_snapshot" :: held 3.847s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_snapshot" :: held 3.887s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:29 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Created reservations ['1ef00a61-e585-4b04-8fc6-6efe4e075d03', '67efca94-fd1d-4193-8cbf-f51b4eacb5f0', '7ebb9ee0-1169-4e8e-b703-46c2813450e8', '4af5fc14-9fd6-4ddb-8da7-771c5fb44091'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Delete snapshot completed successfully. Jul 09 01:19:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18f52371-3c3c-4249-bbb1-5c8c71e0468d tempest-SnapshotsActionsTest-347100501 None] Lock "cinder-fb11418b-0764-4c38-8a1b-58a265d4c358-delete_snapshot" released by "delete_snapshot" :: held 4.042s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "cinder-5a78e8d0-0891-4def-92bd-6bf62d17ee6e-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-5a78e8d0-0891-4def-92bd-6bf62d17ee6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "cinder-quobyte-5a78e8d0-0891-4def-92bd-6bf62d17ee6e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-5a78e8d0-0891-4def-92bd-6bf62d17ee6e" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Deleting offline snapshot 5a78e8d0-0891-4def-92bd-6bf62d17ee6e of volume a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] snapshot_file for this snap is: volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[408933c2-aadb-4564-a810-4a0c7fb8a53d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:30 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:30 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:31 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 1.023s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:19:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793645c-7326-44e2-97e6-01ca793ae83b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:31 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 Jul 09 01:19:31 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:32 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" returned: 0 in 0.874s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:32 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:32 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:33 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.978s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:33 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e Jul 09 01:19:33 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:33 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:33 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:34 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58.5a78e8d0-0891-4def-92bd-6bf62d17ee6e" returned: 0 in 0.916s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-5a78e8d0-0891-4def-92bd-6bf62d17ee6e" released by "_delete_snapshot" :: held 4.002s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_snapshot" :: held 4.084s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Created reservations ['62d63311-153f-48bf-bdcb-0ee0874d54f1', '220f3e3d-2157-4d25-ace6-0cc23e0ff788', 'c4923c01-f4eb-4001-ac92-1d91d004c8e1', 'ca9b633a-08ec-4ae1-b333-09318a4beaa3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:34 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Delete snapshot completed successfully. Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-634060fe-c0b1-4d4f-9b33-6c3fbaae7f4f tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-5a78e8d0-0891-4def-92bd-6bf62d17ee6e-delete_snapshot" released by "delete_snapshot" :: held 4.340s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:34 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.046s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:19:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-083c1345-36d0-4e7d-9434-d3edf179c853 tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" by "attach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-083c1345-36d0-4e7d-9434-d3edf179c853 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" acquired by "attach_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-083c1345-36d0-4e7d-9434-d3edf179c853 tempest-VolumesActionsTest-940477369 None] Attaching volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96 to instance 6ad92730-97c1-4b9b-9903-d1a5cc6fcc54 at mountpoint /dev/vdb on host None. Jul 09 01:19:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-083c1345-36d0-4e7d-9434-d3edf179c853 tempest-VolumesActionsTest-940477369 None] Attach volume completed successfully. Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "cinder-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-083c1345-36d0-4e7d-9434-d3edf179c853 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" released by "attach_volume" :: held 0.193s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb23e2c-7371-4259-941d-448e51a71aa4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:35 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 Jul 09 01:19:35 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1618dbf4-c726-46d0-9b41-f6685889eb9d tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" by "detach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1618dbf4-c726-46d0-9b41-f6685889eb9d tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1618dbf4-c726-46d0-9b41-f6685889eb9d tempest-VolumesActionsTest-940477369 None] Detaching volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96 from instance 6ad92730-97c1-4b9b-9903-d1a5cc6fcc54. Jul 09 01:19:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1618dbf4-c726-46d0-9b41-f6685889eb9d tempest-VolumesActionsTest-940477369 None] Detach volume completed successfully. Jul 09 01:19:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1618dbf4-c726-46d0-9b41-f6685889eb9d tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:36 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:36 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58 Jul 09 01:19:36 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:37 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" returned: 0 in 0.776s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-quobyte-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58" released by "delete_volume" :: held 1.761s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Created reservations ['d058e79b-8bba-4bfe-be24-c3c2f3746b2c', 'aea0d061-06d3-4d47-9bbd-4e5b68ae102f', 'e6d70d4c-3f96-4884-8d43-92ca52a4322b', '1d73a8f7-8cad-402e-9e36-88261dbdbc01'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:37 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:37 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:38 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.747s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:38 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Deleted volume successfully. Jul 09 01:19:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-85cc10eb-de2a-4bf1-96dc-141107228574 tempest-SnapshotsActionsTest-1500979108 None] Lock "cinder-a4a2ef38-a5a5-4d87-bdc8-bf63dfb1ce58-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:47 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=65,cinder:INSERT=18,cinder:UPDATE=78,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:19:48 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:DELETE=4,cinder:UPDATE=67,cinder:SELECT=68,cinder:INSERT=23 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Flow 'volume_create_manager' (6301897e-7ba6-43f5-adc4-1c0e659be2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1623d40-8c14-4bb1-9c79-1700ea8888de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1623d40-8c14-4bb1-9c79-1700ea8888de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-801280997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8514abb2-00df-4aa6-8e61-2079002fd49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cac818e6994bcca6d6f655dc6ecd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:50Z,use_quota=True,user_id='a5f2f5d13c454b05bf4888630b32050d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765e3b18-95ca-4b18-b358-1bbbf02c04ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765e3b18-95ca-4b18-b358-1bbbf02c04ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe8e66-1ac9-487e-9ea1-9a2e1e515535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe8e66-1ac9-487e-9ea1-9a2e1e515535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8514abb2-00df-4aa6-8e61-2079002fd49e', 'volume_name': 'volume-8514abb2-00df-4aa6-8e61-2079002fd49e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f8d013-1ef0-4b4e-be0d-4332c784efcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f8d013-1ef0-4b4e-be0d-4332c784efcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ddcf85-9212-4d2e-b063-98ddda12eeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:49 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Volume 8514abb2-00df-4aa6-8e61-2079002fd49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8514abb2-00df-4aa6-8e61-2079002fd49e', 'volume_size': 1} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-801280997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8514abb2-00df-4aa6-8e61-2079002fd49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cac818e6994bcca6d6f655dc6ecd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:50Z,use_quota=True,user_id='a5f2f5d13c454b05bf4888630b32050d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Creating volume 8514abb2-00df-4aa6-8e61-2079002fd49e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:19:49 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:19:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:49 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e 1073741824 Jul 09 01:19:49 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:50 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e 1073741824" returned: 0 in 1.036s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:50 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e Jul 09 01:19:50 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:51 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Flow 'volume_create_manager' (bcae7fa8-5a96-4746-ab5e-2c67df615545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00783288-2a22-4ccd-b675-c25033dbf9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ddcf85-9212-4d2e-b063-98ddda12eeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8514abb2-00df-4aa6-8e61-2079002fd49e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd82d2-62e7-42a2-8bbe-2a60a071e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00783288-2a22-4ccd-b675-c25033dbf9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-967829628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a155c4-23a8-4275-a6e2-a58c7fe66ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69157d13124fc19f26cb5d81a52537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:52Z,use_quota=True,user_id='acb423662e8d499fb7b1f1b7dd9c1eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7b95b8-a1ef-4605-b330-a8846d455a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7b95b8-a1ef-4605-b330-a8846d455a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc80f4-4c6d-40b8-8a33-b144489b0710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc80f4-4c6d-40b8-8a33-b144489b0710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a155c4-23a8-4275-a6e2-a58c7fe66ada', 'volume_name': 'volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b0e7fc-0f45-434c-aa47-a9eebffcfc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b0e7fc-0f45-434c-aa47-a9eebffcfc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847c673-2a76-4915-9f56-6665045031f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:51 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume 22a155c4-23a8-4275-a6e2-a58c7fe66ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada', 'volume_size': 1} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-967829628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a155c4-23a8-4275-a6e2-a58c7fe66ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69157d13124fc19f26cb5d81a52537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:52Z,use_quota=True,user_id='acb423662e8d499fb7b1f1b7dd9c1eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Creating volume 22a155c4-23a8-4275-a6e2-a58c7fe66ada {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:19:51 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:51 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Volume volume-8514abb2-00df-4aa6-8e61-2079002fd49e (8514abb2-00df-4aa6-8e61-2079002fd49e): created successfully Jul 09 01:19:51 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada 1073741824 Jul 09 01:19:51 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd82d2-62e7-42a2-8bbe-2a60a071e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Flow 'volume_create_manager' (6301897e-7ba6-43f5-adc4-1c0e659be2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7a0f9fba-286e-40b7-bbe6-8eb680d4192b tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Created volume successfully. Jul 09 01:19:52 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada 1073741824" returned: 0 in 0.842s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:52 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada Jul 09 01:19:52 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:53 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada" returned: 0 in 0.675s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b847c673-2a76-4915-9f56-6665045031f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a460f0-de85-43af-989c-f5db228e019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:53 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada (22a155c4-23a8-4275-a6e2-a58c7fe66ada): created successfully Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a460f0-de85-43af-989c-f5db228e019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Flow 'volume_create_manager' (bcae7fa8-5a96-4746-ab5e-2c67df615545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-13ad1439-5546-4a7f-af0e-73e56cf84d3e tempest-VolumeQuotasAdminTestJSON-592627721 None] Created volume successfully. Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Acquiring lock "cinder-8514abb2-00df-4aa6-8e61-2079002fd49e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "cinder-8514abb2-00df-4aa6-8e61-2079002fd49e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Acquiring lock "cinder-quobyte-8514abb2-00df-4aa6-8e61-2079002fd49e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "cinder-quobyte-8514abb2-00df-4aa6-8e61-2079002fd49e" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e42a185-73fa-4fa6-9e01-12a58d022b00]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "cinder-22a155c4-23a8-4275-a6e2-a58c7fe66ada-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "cinder-22a155c4-23a8-4275-a6e2-a58c7fe66ada-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "cinder-quobyte-22a155c4-23a8-4275-a6e2-a58c7fe66ada" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:54 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e Jul 09 01:19:54 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "cinder-quobyte-22a155c4-23a8-4275-a6e2-a58c7fe66ada" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42939a-cd96-4f62-bab5-855cde7dd3ef]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:54 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada Jul 09 01:19:54 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:54 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e" returned: 0 in 0.907s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:54 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e Jul 09 01:19:54 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:55 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada" returned: 0 in 1.034s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:55 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada Jul 09 01:19:55 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:55 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8514abb2-00df-4aa6-8e61-2079002fd49e" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "cinder-quobyte-8514abb2-00df-4aa6-8e61-2079002fd49e" released by "delete_volume" :: held 1.813s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Created reservations ['b0fd5bbb-53c4-4776-bc7d-0078948cfba7', '68250c61-efdd-4113-bb1d-9c5cf50732a1', '1760dead-d4e5-4bba-bd2e-89b86e8e6e54', 'e4657480-6430-4083-8dd5-77c5495eda51'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:55 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:55 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:55 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22a155c4-23a8-4275-a6e2-a58c7fe66ada" returned: 0 in 0.798s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "cinder-quobyte-22a155c4-23a8-4275-a6e2-a58c7fe66ada" released by "delete_volume" :: held 1.894s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Created reservations ['382ef62a-acbd-4b69-a9fc-43affc821691', '2871032a-9cab-4f53-9871-bbc32cda6fed', '9938a9fa-ab5c-4552-ba03-9ad4140d47a0', '755e7a5a-e150-41ea-a1c4-e20e00e02c4d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:56 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:19:56 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:56 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.028s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Deleted volume successfully. Jul 09 01:19:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0cc558e2-af62-4608-a041-9363d694c119 tempest-VolumeQuotasNegativeTestJSON-1704052830 None] Lock "cinder-8514abb2-00df-4aa6-8e61-2079002fd49e-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Flow 'volume_create_manager' (9607517d-cb1a-4d99-b76b-437cbc75ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84a67dc-b4a2-4c7c-89d6-4bb918e52a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:57 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84a67dc-b4a2-4c7c-89d6-4bb918e52a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-229531196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec919ebb-010b-4f00-b450-9ab46ffeea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69157d13124fc19f26cb5d81a52537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:57Z,use_quota=True,user_id='acb423662e8d499fb7b1f1b7dd9c1eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a674529f-3e1a-4c39-9e98-683af4d14f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a674529f-3e1a-4c39-9e98-683af4d14f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec927ccd-b602-4b88-82a6-34a8e798baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec927ccd-b602-4b88-82a6-34a8e798baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec919ebb-010b-4f00-b450-9ab46ffeea5c', 'volume_name': 'volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6a533e-69a5-4e1b-afe0-0c41353c1bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6a533e-69a5-4e1b-afe0-0c41353c1bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df463dde-bfda-4c52-9aa8-b1929bb92b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:57 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume ec919ebb-010b-4f00-b450-9ab46ffeea5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c', 'volume_size': 1} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-229531196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec919ebb-010b-4f00-b450-9ab46ffeea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69157d13124fc19f26cb5d81a52537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:19:57Z,use_quota=True,user_id='acb423662e8d499fb7b1f1b7dd9c1eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Creating volume ec919ebb-010b-4f00-b450-9ab46ffeea5c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:19:57 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.095s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:19:57 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Deleted volume successfully. Jul 09 01:19:57 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c 1073741824 Jul 09 01:19:57 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-89abd87b-202f-4b1f-98bd-93bb0aa7c933 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "cinder-22a155c4-23a8-4275-a6e2-a58c7fe66ada-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:19:58 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c 1073741824" returned: 0 in 1.146s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:19:58 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c Jul 09 01:19:58 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:19:59 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c" returned: 0 in 0.944s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df463dde-bfda-4c52-9aa8-b1929bb92b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3089b3e3-2abb-44fa-8ad5-2e1a7d29e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:19:59 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Volume volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c (ec919ebb-010b-4f00-b450-9ab46ffeea5c): created successfully Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3089b3e3-2abb-44fa-8ad5-2e1a7d29e700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Flow 'volume_create_manager' (9607517d-cb1a-4d99-b76b-437cbc75ede0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:19:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a88a4557-4d29-44e9-8220-d12b18572260 tempest-VolumeQuotasAdminTestJSON-592627721 None] Created volume successfully. Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b53e87d4-fc9a-40ad-b887-583853e5570a tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" by "attach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:19:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b53e87d4-fc9a-40ad-b887-583853e5570a tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" acquired by "attach_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b53e87d4-fc9a-40ad-b887-583853e5570a tempest-VolumesActionsTest-940477369 None] Attaching volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96 to instance cc6ac4b1-c452-4f79-b7a1-c801ae1e5533 at mountpoint /dev/vdb on host None. Jul 09 01:20:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b53e87d4-fc9a-40ad-b887-583853e5570a tempest-VolumesActionsTest-940477369 None] Attach volume completed successfully. Jul 09 01:20:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b53e87d4-fc9a-40ad-b887-583853e5570a tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" released by "attach_volume" :: held 0.124s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8a5e871-0bc9-4d8b-aa69-65147cc5c0b8 tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" by "detach_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8a5e871-0bc9-4d8b-aa69-65147cc5c0b8 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c8a5e871-0bc9-4d8b-aa69-65147cc5c0b8 tempest-VolumesActionsTest-940477369 None] Detaching volume e35e0dbd-7eb0-4c6d-b000-167129d5bc96 from instance cc6ac4b1-c452-4f79-b7a1-c801ae1e5533. Jul 09 01:20:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c8a5e871-0bc9-4d8b-aa69-65147cc5c0b8 tempest-VolumesActionsTest-940477369 None] Detach volume completed successfully. Jul 09 01:20:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c8a5e871-0bc9-4d8b-aa69-65147cc5c0b8 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f1f6782d-1fdb-4109-9da0-9190d5698171 tempest-VolumeQuotasAdminTestJSON-1328126889 None] Transfer volume completed successfully. Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Acquiring lock "cinder-ec919ebb-010b-4f00-b450-9ab46ffeea5c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "cinder-ec919ebb-010b-4f00-b450-9ab46ffeea5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Acquiring lock "cinder-quobyte-ec919ebb-010b-4f00-b450-9ab46ffeea5c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "cinder-quobyte-ec919ebb-010b-4f00-b450-9ab46ffeea5c" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae7998-868f-43a1-93a6-0f39c914da65]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:02 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c Jul 09 01:20:02 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:03 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c" returned: 0 in 0.832s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:03 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c Jul 09 01:20:03 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:03 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ec919ebb-010b-4f00-b450-9ab46ffeea5c" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "cinder-quobyte-ec919ebb-010b-4f00-b450-9ab46ffeea5c" released by "delete_volume" :: held 1.717s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:03 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Created reservations ['24f61fc5-4f2a-47c8-8184-f0b5e4ab9d33', 'b1d06a20-93dc-4f3c-a0dd-d3a2da490671', 'c239b564-1c69-4603-9f07-611bffac6988', '261ed9df-3964-4a25-bf50-9bec7c6d8b2f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:04 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:04 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:04 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.939s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:20:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Deleted volume successfully. Jul 09 01:20:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-75595943-a970-4d3e-a718-33530d274159 tempest-VolumeQuotasAdminTestJSON-854364717 None] Lock "cinder-ec919ebb-010b-4f00-b450-9ab46ffeea5c-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Flow 'volume_create_manager' (37be5d0b-9456-433d-9a27-e70f869bd0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a29045-cce8-4894-adb8-e604cf0d60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a29045-cce8-4894-adb8-e604cf0d60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-19554606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695b1a86-52ad-4d2c-a686-fe4f9acd72bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f390e869d054c048e3f85fe6c35060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:20:09Z,use_quota=True,user_id='b8f161afe6c149bcb5b7dec2f4531536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ab2c7e-a48f-4a05-8214-92a1d641ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ab2c7e-a48f-4a05-8214-92a1d641ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9a142-5da5-40b0-b622-92f10e06c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9a142-5da5-40b0-b622-92f10e06c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695b1a86-52ad-4d2c-a686-fe4f9acd72bf', 'volume_name': 'volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ab5a88-a427-4f8f-8530-f50401fd7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ab5a88-a427-4f8f-8530-f50401fd7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec85109-2444-4f87-986a-ed7c1c72ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Volume 695b1a86-52ad-4d2c-a686-fe4f9acd72bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf', 'volume_size': 1} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-19554606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695b1a86-52ad-4d2c-a686-fe4f9acd72bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f390e869d054c048e3f85fe6c35060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:20:09Z,use_quota=True,user_id='b8f161afe6c149bcb5b7dec2f4531536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Creating volume 695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:20:08 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:20:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:09 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf 1073741824 Jul 09 01:20:09 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:09 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf 1073741824" returned: 0 in 0.968s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:10 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf Jul 09 01:20:10 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:10 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec85109-2444-4f87-986a-ed7c1c72ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0f4486-edb5-414b-a21f-87b8ea94c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:10 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Volume volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf (695b1a86-52ad-4d2c-a686-fe4f9acd72bf): created successfully Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0f4486-edb5-414b-a21f-87b8ea94c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Flow 'volume_create_manager' (37be5d0b-9456-433d-9a27-e70f869bd0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:20:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2874506b-82be-46cb-9a83-bce429c1a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Created volume successfully. Jul 09 01:20:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47c8d4-cee5-4852-be0e-0a344a217f63]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:11 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:11 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:12 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Flow 'volume_create_manager' (27c6d04e-ef7d-419e-8309-56a6b12b9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363c568c-6e5f-4ca7-8277-19bcb65f1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.844s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363c568c-6e5f-4ca7-8277-19bcb65f1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1210596952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb7b8c50552438cbf527c528639b3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:20:12Z,use_quota=True,user_id='ca3622ec1e924f2581bed1b994a98129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45077e51-3a58-45d8-9c7c-c4c440ceec09),volume_type_id=45077e51-3a58-45d8-9c7c-c4c440ceec09)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6371e182-1dc4-4e1b-928f-55b8e3d786ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6371e182-1dc4-4e1b-928f-55b8e3d786ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47a7dd6-3748-47cc-92d8-65d27df12364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47a7dd6-3748-47cc-92d8-65d27df12364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7', 'volume_name': 'volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a4ed6d-ccbf-4c3a-84e1-8d24eb7be32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a4ed6d-ccbf-4c3a-84e1-8d24eb7be32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba08d5d3-d831-4490-9d14-a12c8903a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Volume 9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7', 'volume_size': 1} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[23866fb8-31e2-4fbf-903c-36d99512d5df]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:12 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:12 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:12 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.763s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.f1dda9b2-9165-4440-9ecd-e9d415dad190c63loorp.img {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:12 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.f1dda9b2-9165-4440-9ecd-e9d415dad190c63loorp.img Jul 09 01:20:12 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:17 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.f1dda9b2-9165-4440-9ecd-e9d415dad190c63loorp.img" returned: 0 in 4.381s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:17 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e9e06-e6c2-4771-8a5d-85fa25384ecc]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:17 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:17 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:18 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:18 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.f1dda9b2-9165-4440-9ecd-e9d415dad190c63loorp.img {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:20:18 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Converted 1024.00 MB image at 233.66 MB/s Jul 09 01:20:18 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] f1dda9b2-9165-4440-9ecd-e9d415dad190 was raw, no need to convert to raw {{(pid=86954) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=44,cinder:SELECT=30,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:33 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:33 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:34 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:20:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:20:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:20:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.955s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Uploaded volume to glance image-id: f1dda9b2-9165-4440-9ecd-e9d415dad190. {{(pid=86954) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.946s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Creating offline snapshot 20164a82-05a6-49b5-8071-d9e1b0ba386c of volume 695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:20:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e3cc8f22-dbcf-4c4b-b03a-ca2d21548c92 tempest-VolumesActionsTest-940477369 None] Copy volume to image completed successfully. Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75cc810-c6a2-4378-ab44-9804e7ea6785]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:37 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf Jul 09 01:20:37 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:37 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:38 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c 1G Jul 09 01:20:38 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:38 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c 1G" returned: 0 in 0.800s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:38 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c Jul 09 01:20:38 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:39 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:39 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c is being set with open permissions: ugo+rw Jul 09 01:20:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:39 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c Jul 09 01:20:39 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:40 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c" returned: 0 in 0.647s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:40 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info Jul 09 01:20:40 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:40 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:40 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info is being set with open permissions: ugo+rw Jul 09 01:20:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:40 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info Jul 09 01:20:40 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:41 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.info" returned: 0 in 0.641s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.399s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1210596952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb7b8c50552438cbf527c528639b3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:20:12Z,use_quota=True,user_id='ca3622ec1e924f2581bed1b994a98129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45077e51-3a58-45d8-9c7c-c4c440ceec09),volume_type_id=45077e51-3a58-45d8-9c7c-c4c440ceec09)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Creating volume 9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:20:41 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:20:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:41 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 1073741824 Jul 09 01:20:41 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e00f6130-e957-4ebd-ac62-e3aad416a092 tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Create snapshot completed successfully Jul 09 01:20:42 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 1073741824" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:42 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 Jul 09 01:20:42 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "cinder-20164a82-05a6-49b5-8071-d9e1b0ba386c-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-20164a82-05a6-49b5-8071-d9e1b0ba386c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "cinder-quobyte-20164a82-05a6-49b5-8071-d9e1b0ba386c" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-20164a82-05a6-49b5-8071-d9e1b0ba386c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Deleting offline snapshot 20164a82-05a6-49b5-8071-d9e1b0ba386c of volume 695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] snapshot_file for this snap is: volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f326e8-03ad-42f1-a5e4-88c0606f0dff]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:43 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.022s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9419b5-8637-4d35-a407-93c46aaebf38]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba08d5d3-d831-4490-9d14-a12c8903a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257a9ae1-ef02-418a-a187-6298e3bf0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:20:43 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c Jul 09 01:20:43 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Volume volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 (9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7): created successfully Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257a9ae1-ef02-418a-a187-6298e3bf0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Flow 'volume_create_manager' (27c6d04e-ef7d-419e-8309-56a6b12b9265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:20:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c8559a0f-e8a0-427e-bbc8-1238315d4a66 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Created volume successfully. Jul 09 01:20:43 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:43 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:43 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c" returned: 0 in 0.800s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[98166cd7-b81d-426c-ad53-fcb3081a21c6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:43 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.772s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[452631b9-560c-4c11-8c73-066ac38536ae]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:43 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf Jul 09 01:20:43 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:43 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:43 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:44 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:44 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:44 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" returned: 0 in 0.839s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:44 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c Jul 09 01:20:44 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:44 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:44 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img Jul 09 01:20:44 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:45 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.707s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:20:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3f39b75b-d5fc-4cee-8498-8c618c4e44f8 tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Retype volume completed successfully. Jul 09 01:20:45 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c" returned: 0 in 1.121s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:45 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c Jul 09 01:20:45 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "cinder-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "cinder-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "cinder-quobyte-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "cinder-quobyte-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" acquired by "delete_volume" :: waited 0.049s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc689aa5-143a-4b9a-8723-6b019f8b1ffa]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:46 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 Jul 09 01:20:46 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:47 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf.20164a82-05a6-49b5-8071-d9e1b0ba386c" returned: 0 in 1.322s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-20164a82-05a6-49b5-8071-d9e1b0ba386c" released by "_delete_snapshot" :: held 4.257s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" released by "delete_snapshot" :: held 4.291s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:47 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Created reservations ['b0771498-ddc0-4655-acde-e0ad8e8b8ce9', 'd840557c-900d-4fea-801d-e3224c9a0bda', '49ae64da-eaa3-48c0-9118-0f3673d282a8', 'b0d3e757-ea12-46c9-9ab6-167bf70e7d6c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:20:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Delete snapshot completed successfully. Jul 09 01:20:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b54b90f6-c4f8-4f5c-85f6-9391ae29241a tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-20164a82-05a6-49b5-8071-d9e1b0ba386c-delete_snapshot" released by "delete_snapshot" :: held 4.713s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:48 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" returned: 0 in 1.586s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:48 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7 Jul 09 01:20:48 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "cinder-695b1a86-52ad-4d2c-a686-fe4f9acd72bf-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-695b1a86-52ad-4d2c-a686-fe4f9acd72bf-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" acquired by "delete_volume" :: waited 0.052s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a11f73-7d37-4b8d-85c5-ba9e08292375]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:49 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf Jul 09 01:20:49 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:49 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" returned: 0 in 1.042s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "cinder-quobyte-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7" released by "delete_volume" :: held 2.759s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:49 devstack cinder-volume[86954]: WARNING cinder.quota [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:20:49 devstack cinder-volume[86954]: WARNING cinder.quota [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Created reservations ['853decb4-df06-4a5a-a9d2-7a80c49f06d8', 'ffd46be2-18e6-470e-81cb-19e3bff3d671', '8de2f881-bfc3-4a82-b1df-6250936bff26', 'be233e1c-bbc6-4fd0-980b-644ea99d0483'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:49 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:49 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:50 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img" returned: 0 in 5.534s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e6f183-830d-4bf2-875e-dd2c16d0f5e9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:50 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" returned: 0 in 1.416s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:50 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf Jul 09 01:20:50 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:50 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:50 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:50 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.029s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:20:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Deleted volume successfully. Jul 09 01:20:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3d8bed00-c755-4a9e-b31a-d55d74c8fb3f tempest-VolumeRetypeWithoutMigrationTest-878853762 None] Lock "cinder-9b9bea8a-00ed-4ddf-bde3-f21f5033dfd7-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:50 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" returned: 0 in 0.733s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-quobyte-695b1a86-52ad-4d2c-a686-fe4f9acd72bf" released by "delete_volume" :: held 2.277s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Created reservations ['83c72bcc-c42e-445e-be98-c14d937decad', 'a6757981-9e21-416f-8867-64e9dab519b4', '4f989eb7-9a7d-4577-84cf-1b1ab64e9b57', 'f4db5553-8a25-4814-b6a1-7ce2012768e7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:51 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:51 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:51 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 1.108s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:20:51 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Converted 1024.00 MB image at 184.94 MB/s Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] a83c2e1a-a345-4bad-a882-abd778286629 was raw, converting to qcow2 {{(pid=86954) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa94183-66dc-4d55-9be0-278f32f7ca31]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:51 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img Jul 09 01:20:51 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:51 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:20:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Deleted volume successfully. Jul 09 01:20:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eeb95ce9-5eec-4bbd-9ce6-363014689b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-645322769 None] Lock "cinder-695b1a86-52ad-4d2c-a686-fe4f9acd72bf-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:52 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img" returned: 0 in 0.816s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:52 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img Jul 09 01:20:52 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:52 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img" returned: 1 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:20:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img /opt/stack/data/cinder/conversion/vol_upload_3pedfo14 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:53 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img /opt/stack/data/cinder/conversion/vol_upload_3pedfo14 Jul 09 01:20:53 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:53 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img /opt/stack/data/cinder/conversion/vol_upload_3pedfo14" returned: 0 in 0.776s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:53 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Image conversion details: src /opt/stack/data/cinder/conversion/e35e0dbd-7eb0-4c6d-b000-167129d5bc96.temp_image.a83c2e1a-a345-4bad-a882-abd778286629pj73f3mv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3pedfo14 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:20:53 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 01:20:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1f06d-cbcb-4932-bf81-465253f1981e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pedfo14 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:53 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pedfo14 Jul 09 01:20:53 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:54 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pedfo14" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.220s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Uploaded volume to glance image-id: a83c2e1a-a345-4bad-a882-abd778286629. {{(pid=86954) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 01:20:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ee4ffd4e-79ef-4628-a942-5bfe1b7b87b8 tempest-VolumesActionsTest-940477369 None] Copy volume to image completed successfully. Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Acquiring lock "cinder-quobyte-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "cinder-quobyte-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" acquired by "delete_volume" :: waited 0.041s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1945b8b-1995-430a-9f3e-b1dc7e71a5e7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:20:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:57 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:57 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:58 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.936s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:58 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96 Jul 09 01:20:58 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:20:59 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" returned: 0 in 0.786s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "cinder-quobyte-e35e0dbd-7eb0-4c6d-b000-167129d5bc96" released by "delete_volume" :: held 1.776s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Created reservations ['34a34b59-a06a-4f17-9589-28a714e99fad', '541deb29-8e05-4003-9248-2f85672170af', '5695030d-caa9-4477-9900-f6e9135b5d9d', '9af50099-8829-42c4-be0a-ad3a7fa2de7c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:20:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:20:59 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:20:59 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:00 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.704s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Deleted volume successfully. Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3456870a-75d4-475c-b8bc-95f9deaee595 tempest-VolumesActionsTest-940477369 None] Lock "cinder-e35e0dbd-7eb0-4c6d-b000-167129d5bc96-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Flow 'volume_create_manager' (7f7d494f-33bd-4dfe-b8f6-2b2c271f87c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aead5630-9731-4d22-9d40-b0a5cf79efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aead5630-9731-4d22-9d40-b0a5cf79efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-733963762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01161d97-d6ea-45e1-9224-041b36116856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43c2296547e476d96121103f8ad7ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:01Z,use_quota=True,user_id='51b4e2e6b25143299184c742c4c94bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdbf6bc-f84b-47b1-9b83-b2a8cb1016f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdbf6bc-f84b-47b1-9b83-b2a8cb1016f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446ed8de-8b04-4ef9-a0a6-d61a8979e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:00 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446ed8de-8b04-4ef9-a0a6-d61a8979e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01161d97-d6ea-45e1-9224-041b36116856', 'volume_name': 'volume-01161d97-d6ea-45e1-9224-041b36116856', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fbaf10-628b-49a4-a79c-90efb3f22139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fbaf10-628b-49a4-a79c-90efb3f22139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b1525-98b6-419d-9e13-2d36ef368ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Volume 01161d97-d6ea-45e1-9224-041b36116856: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01161d97-d6ea-45e1-9224-041b36116856', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Trying to clone 01161d97-d6ea-45e1-9224-041b36116856 from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Flow 'volume_create_manager' (a8fcd5ce-6bd5-4c27-816b-ebffca71e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22792ff3-1b07-48d7-8a11-d38f83898665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22792ff3-1b07-48d7-8a11-d38f83898665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713085639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f75bb8-fe76-4654-a7a3-26749190e529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdb35bdded34dd39d65b72dd993b7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:01Z,use_quota=True,user_id='1cff4cfff4814848b04215861a469bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c49d1b-4a3e-4412-876c-74bf3b92a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c49d1b-4a3e-4412-876c-74bf3b92a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682c5324-636f-4a8b-a67e-dd79fe57ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682c5324-636f-4a8b-a67e-dd79fe57ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f75bb8-fe76-4654-a7a3-26749190e529', 'volume_name': 'volume-e9f75bb8-fe76-4654-a7a3-26749190e529', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dab6c6-c23a-4059-94a4-e85efce34836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dab6c6-c23a-4059-94a4-e85efce34836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18e55d3-e1db-44a8-b5dc-069b9f2d72a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:01 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Volume e9f75bb8-fe76-4654-a7a3-26749190e529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f75bb8-fe76-4654-a7a3-26749190e529', 'volume_size': 1} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713085639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f75bb8-fe76-4654-a7a3-26749190e529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdb35bdded34dd39d65b72dd993b7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:01Z,use_quota=True,user_id='1cff4cfff4814848b04215861a469bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Creating volume e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:01 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:01 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 1073741824 Jul 09 01:21:01 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:21:01 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Image download 20.69 MB at 20.69 MB/s Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b730f1f4-4237-42af-832b-1f9c2c0c33bc]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:01 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD Jul 09 01:21:01 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:02 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 1073741824" returned: 0 in 0.943s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:02 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 is fetched for user 51b4e2e6b25143299184c742c4c94bff. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:02 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 Jul 09 01:21:02 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92623f7-9b1b-47de-b77a-ebe51ce11a44]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:02 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD Jul 09 01:21:02 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:03 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529" returned: 0 in 0.787s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18e55d3-e1db-44a8-b5dc-069b9f2d72a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f75bb8-fe76-4654-a7a3-26749190e529', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9b818a-0abe-4c3a-a137-7bcaeae3550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Volume volume-e9f75bb8-fe76-4654-a7a3-26749190e529 (e9f75bb8-fe76-4654-a7a3-26749190e529): created successfully Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9b818a-0abe-4c3a-a137-7bcaeae3550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Flow 'volume_create_manager' (a8fcd5ce-6bd5-4c27-816b-ebffca71e248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-498ddeba-24b6-4978-9118-a98e59c791bd tempest-SnapshotMetadataTestJSON-663731265 None] Created volume successfully. Jul 09 01:21:03 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-733963762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01161d97-d6ea-45e1-9224-041b36116856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43c2296547e476d96121103f8ad7ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:01Z,use_quota=True,user_id='51b4e2e6b25143299184c742c4c94bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Creating volume 01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:03 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:03 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1073741824 Jul 09 01:21:03 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:04 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1073741824" returned: 0 in 0.874s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:04 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:04 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:05 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.318s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Creating offline snapshot 1ade75f3-f502-44a7-9f32-e537b63d3e21 of volume e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Attempting download of 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 01161d97-d6ea-45e1-9224-041b36116856. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7bb43a-51a8-4a3e-86af-1b41d4e38671]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d06340-db12-4a8f-b436-e18df151edcc]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:05 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 Jul 09 01:21:05 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:05 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb Jul 09 01:21:05 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:05 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529" returned: 0 in 0.817s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:05 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:05 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 1G Jul 09 01:21:05 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:06 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb Jul 09 01:21:06 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Flow 'volume_create_manager' (1ee45e64-eafe-4886-860e-8fdfab247380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530d4fc2-91ba-4795-aee6-cc830aae2718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530d4fc2-91ba-4795-aee6-cc830aae2718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1908421137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d037a6-e1ec-421d-8c7b-d5580aaf7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eb69be77d64324b21e4da18886eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:06Z,use_quota=True,user_id='adb9cc6e2f3044a09f411d0a4a856461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3deca98-c491-4c69-80c7-27ac836661b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3deca98-c491-4c69-80c7-27ac836661b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aba56ce-42fd-4ca9-98ea-33af2f10a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aba56ce-42fd-4ca9-98ea-33af2f10a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d037a6-e1ec-421d-8c7b-d5580aaf7a22', 'volume_name': 'volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22', 'volume_size': 2}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c552d988-7bcb-46c4-80e4-961d5b710d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c552d988-7bcb-46c4-80e4-961d5b710d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7256083-b602-4903-8803-981ee1696d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Volume 56d037a6-e1ec-421d-8c7b-d5580aaf7a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22', 'volume_size': 2} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:06 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb" returned: 1 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_is3_w8tb' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fe97c-3e54-462c-9417-d7cc5c841cc9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:06 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 1G" returned: 0 in 0.879s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f75bb8-fe76-4654-a7a3-26749190e529 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:06 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f75bb8-fe76-4654-a7a3-26749190e529 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 Jul 09 01:21:06 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:06 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD Jul 09 01:21:06 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:07 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f75bb8-fe76-4654-a7a3-26749190e529 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21" returned: 0 in 0.719s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:07 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 is being set with open permissions: ugo+rw Jul 09 01:21:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:07 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:07 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] 52f835e6-23a6-4938-9b95-f63e8048dcd3 was qcow2, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:21:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:07 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 Jul 09 01:21:07 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:07 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:07 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:08 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21" returned: 0 in 0.651s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:08 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info Jul 09 01:21:08 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:08 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:08 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info is being set with open permissions: ugo+rw Jul 09 01:21:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:08 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info Jul 09 01:21:08 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:09 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 0 in 1.880s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_6wosqx2jdevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:21:09 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Converted 112.00 MB image at 59.52 MB/s Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:09 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1G Jul 09 01:21:09 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:09 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.info" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.617s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.281s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1908421137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d037a6-e1ec-421d-8c7b-d5580aaf7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eb69be77d64324b21e4da18886eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:06Z,use_quota=True,user_id='adb9cc6e2f3044a09f411d0a4a856461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Creating volume 56d037a6-e1ec-421d-8c7b-d5580aaf7a22 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:09 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 2147483648 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:09 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 2147483648 Jul 09 01:21:09 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ff4c13ed-f375-4a5d-82cc-8b023d7a8d07 tempest-SnapshotMetadataTestJSON-663731265 None] Create snapshot completed successfully Jul 09 01:21:10 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 1G" returned: 0 in 0.741s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd1fc0-97ed-4947-aa58-a35795e2c9b4]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:10 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:10 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "cinder-1ade75f3-f502-44a7-9f32-e537b63d3e21-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:10 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 2147483648" returned: 0 in 1.057s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-1ade75f3-f502-44a7-9f32-e537b63d3e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "cinder-quobyte-1ade75f3-f502-44a7-9f32-e537b63d3e21" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-1ade75f3-f502-44a7-9f32-e537b63d3e21" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Deleting offline snapshot 1ade75f3-f502-44a7-9f32-e537b63d3e21 of volume e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:21:10 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 Jul 09 01:21:10 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] snapshot_file for this snap is: volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c7c9bf-6703-4756-8a2d-0561229c32c8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:11 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 Jul 09 01:21:11 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:11 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 0 in 0.856s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:11 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:11 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:11 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" returned: 0 in 0.699s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7256083-b602-4903-8803-981ee1696d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22', 'volume_size': 2}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5077e445-8998-42a8-9a58-e137678c4659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Volume volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 (56d037a6-e1ec-421d-8c7b-d5580aaf7a22): created successfully Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5077e445-8998-42a8-9a58-e137678c4659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Flow 'volume_create_manager' (1ee45e64-eafe-4886-860e-8fdfab247380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:11 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7354fd3a-8232-4e93-a048-e8126353b838 tempest-VolumesCloneNegativeTest-2105056590 None] Created volume successfully. Jul 09 01:21:11 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21" returned: 0 in 0.802s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9f75bb8-fe76-4654-a7a3-26749190e529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01b222e-3322-47e6-97b2-9f0ca5955392]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:11 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 Jul 09 01:21:11 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:11 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 1 in 0.816s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Downloaded image 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 01161d97-d6ea-45e1-9224-041b36116856 successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 for user 51b4e2e6b25143299184c742c4c94bff is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Marking volume 01161d97-d6ea-45e1-9224-041b36116856 as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Copying metadata from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 to 01161d97-d6ea-45e1-9224-041b36116856. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:21:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Creating volume glance metadata for volume 01161d97-d6ea-45e1-9224-041b36116856 backed by image 52f835e6-23a6-4938-9b95-f63e8048dcd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b1525-98b6-419d-9e13-2d36ef368ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01161d97-d6ea-45e1-9224-041b36116856', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b478ea-4a2b-4e2c-a9d3-370f83cef6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Volume volume-01161d97-d6ea-45e1-9224-041b36116856 (01161d97-d6ea-45e1-9224-041b36116856): created successfully Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b478ea-4a2b-4e2c-a9d3-370f83cef6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Flow 'volume_create_manager' (7f7d494f-33bd-4dfe-b8f6-2b2c271f87c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Acquiring lock "cinder-56d037a6-e1ec-421d-8c7b-d5580aaf7a22-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:12 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a0edbbca-1066-4695-a889-556a1a2b7979 tempest-VolumesImageMetadata-2102702150 None] Created volume successfully. Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "cinder-56d037a6-e1ec-421d-8c7b-d5580aaf7a22-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Acquiring lock "cinder-quobyte-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "cinder-quobyte-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ee3fd2-d09a-44e0-93e1-de8cb7d14554]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:12 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 Jul 09 01:21:12 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:12 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529" returned: 0 in 0.855s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:12 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 Jul 09 01:21:12 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Acquiring lock "cinder-01161d97-d6ea-45e1-9224-041b36116856-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "cinder-01161d97-d6ea-45e1-9224-041b36116856-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Acquiring lock "cinder-quobyte-01161d97-d6ea-45e1-9224-041b36116856" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:13 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" returned: 0 in 0.823s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "cinder-quobyte-01161d97-d6ea-45e1-9224-041b36116856" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:13 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22 Jul 09 01:21:13 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc68a3-039b-4a45-bb78-d5be72fb05c8]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:13 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:13 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:13 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21" returned: 0 in 0.835s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:13 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21 Jul 09 01:21:13 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:13 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "cinder-quobyte-56d037a6-e1ec-421d-8c7b-d5580aaf7a22" released by "delete_volume" :: held 1.544s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Created reservations ['e1b71eef-2736-488f-b306-bf34fa0395b5', 'cfc4c546-3b56-46f1-8773-a6eab67b9786', '01439f32-a834-426f-8cca-4a7c1d290e16', '1b08d890-f70a-4e1f-b6c2-892a09b61750'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:13 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:13 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:13 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:14 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:14 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:14 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529.1ade75f3-f502-44a7-9f32-e537b63d3e21" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-1ade75f3-f502-44a7-9f32-e537b63d3e21" released by "_delete_snapshot" :: held 3.304s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" released by "delete_snapshot" :: held 3.339s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Created reservations ['3eaaec0a-9353-49f2-b2dd-d181ec73d261', 'fb54d9aa-80bb-4d63-8c0e-da1a5a5bae24', '66a9f8b5-081e-441d-9155-d164db954bb2', '6918a240-6250-4992-9e4b-9b085a5f5f74'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Delete snapshot completed successfully. Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2ffc28d8-c1a6-4a3f-a0ef-91b3f8256423 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-1ade75f3-f502-44a7-9f32-e537b63d3e21-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:14 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Deleted volume successfully. Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ebd1bb37-bbf6-47e6-8a1f-b36e6cb967b2 tempest-VolumesCloneNegativeTest-2105056590 None] Lock "cinder-56d037a6-e1ec-421d-8c7b-d5580aaf7a22-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:14 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 1 in 0.794s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:21:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:14 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856 Jul 09 01:21:14 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "cinder-e9f75bb8-fe76-4654-a7a3-26749190e529-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-e9f75bb8-fe76-4654-a7a3-26749190e529-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3565a-6744-4fe9-ae28-4b23c7dcd95d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:15 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01161d97-d6ea-45e1-9224-041b36116856" returned: 0 in 0.718s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "cinder-quobyte-01161d97-d6ea-45e1-9224-041b36116856" released by "delete_volume" :: held 2.397s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:15 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 Jul 09 01:21:15 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Created reservations ['b72225c1-c68a-4af9-865b-7d2ec7692354', '68bd5b6c-9bda-4992-b2e8-66858389790b', '05f96a8e-627c-4c6c-9b55-ff41b54eaa43', '4debce9a-6592-4ec5-a6ae-148dc6fe8a73'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:15 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:15 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:16 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:16 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529 Jul 09 01:21:16 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:16 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.749s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Deleted volume successfully. Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f921c37c-9d6b-4c88-aaac-15b478a7242c tempest-VolumesImageMetadata-2102702150 None] Lock "cinder-01161d97-d6ea-45e1-9224-041b36116856-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:16 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9f75bb8-fe76-4654-a7a3-26749190e529" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-quobyte-e9f75bb8-fe76-4654-a7a3-26749190e529" released by "delete_volume" :: held 1.668s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Created reservations ['6fe0a701-8a2d-49f2-bf03-e2bb55b31e13', '53e360fb-7c24-4dd0-8f1e-ae3f3cc6344c', '26dc3d8e-25f6-4c7a-adda-3b759c44146b', '0bcf66fa-9ac9-49a9-80e3-3bd362e8e85f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:17 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:17 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:17 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.832s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Deleted volume successfully. Jul 09 01:21:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-dad4cbf7-0b10-4003-a075-23e0739608e2 tempest-SnapshotMetadataTestJSON-663731265 None] Lock "cinder-e9f75bb8-fe76-4654-a7a3-26749190e529-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Flow 'volume_create_manager' (87170c1a-aa78-4c52-8f34-256a9bb806a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc58fc-2627-4ab9-9be1-b77f7a21c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc58fc-2627-4ab9-9be1-b77f7a21c373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1883898193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c2800b5cf0498e8bc6114ea71e5465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:20Z,use_quota=True,user_id='a7b3019d599644399cd8a79a222c3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09161870-0a78-4c61-8b30-675d74fb3ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09161870-0a78-4c61-8b30-675d74fb3ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a869a57-a54e-4dc9-b794-d8c37c9c44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a869a57-a54e-4dc9-b794-d8c37c9c44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f', 'volume_name': 'volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef153a04-0622-4fe3-b424-3fdf8bab9323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef153a04-0622-4fe3-b424-3fdf8bab9323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a9906f-2e49-41df-9ee7-2d54a539ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Volume 59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f', 'volume_size': 1} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1883898193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c2800b5cf0498e8bc6114ea71e5465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:20Z,use_quota=True,user_id='a7b3019d599644399cd8a79a222c3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Creating volume 59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:19 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:19 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f 1073741824 Jul 09 01:21:19 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:20 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f 1073741824" returned: 0 in 0.948s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:20 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f Jul 09 01:21:20 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:21 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" returned: 0 in 0.714s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a9906f-2e49-41df-9ee7-2d54a539ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834e3a43-0e65-41d9-9758-9b434bdb2d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Volume volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f (59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f): created successfully Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834e3a43-0e65-41d9-9758-9b434bdb2d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Flow 'volume_create_manager' (87170c1a-aa78-4c52-8f34-256a9bb806a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6c87f486-4305-4632-aedc-f5dc89ea2576 tempest-VolumesMetadataTest-998852422 None] Created volume successfully. Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Acquiring lock "cinder-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "cinder-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Acquiring lock "cinder-quobyte-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "cinder-quobyte-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f749173-21de-4ce5-aa4a-4336662ed653]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Flow 'volume_create_manager' (a4ad5078-f6f4-4c67-b68b-031b1d80b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:22 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f Jul 09 01:21:22 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19086e23-0730-48d7-9613-4d3ce057ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19086e23-0730-48d7-9613-4d3ce057ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2147067752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97fe302-35b4-4611-9788-ad4d25dd8f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd691f8f34a64a2fa834842c9b074c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:23Z,use_quota=True,user_id='101c3b10c89446d18f6161822422b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28658c9a-a9e5-4212-b2db-6cc16a173a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28658c9a-a9e5-4212-b2db-6cc16a173a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424e563-1d8f-4077-b4b4-3644ea164318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424e563-1d8f-4077-b4b4-3644ea164318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97fe302-35b4-4611-9788-ad4d25dd8f38', 'volume_name': 'volume-a97fe302-35b4-4611-9788-ad4d25dd8f38', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112c17d-3a5f-4ee4-856c-6520e03369a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112c17d-3a5f-4ee4-856c-6520e03369a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89571c9a-9374-42bd-b293-8245409cf0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Volume a97fe302-35b4-4611-9788-ad4d25dd8f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97fe302-35b4-4611-9788-ad4d25dd8f38', 'volume_size': 1} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2147067752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97fe302-35b4-4611-9788-ad4d25dd8f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd691f8f34a64a2fa834842c9b074c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:23Z,use_quota=True,user_id='101c3b10c89446d18f6161822422b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Creating volume a97fe302-35b4-4611-9788-ad4d25dd8f38 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:23 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 1073741824 Jul 09 01:21:23 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:23 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:23 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f Jul 09 01:21:23 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:24 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 1073741824" returned: 0 in 1.012s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:24 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 Jul 09 01:21:24 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:24 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" returned: 0 in 0.755s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "cinder-quobyte-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f" released by "delete_volume" :: held 1.688s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Created reservations ['f1d80bf9-fe3d-4e93-999c-94c7cd94f421', '14595b79-4a0d-4b29-b020-bb5ad8670627', 'ad944ed6-9cf2-42da-8d81-d342c5130186', 'b619df25-839b-4c86-8a54-28d6b25738b2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:24 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:24 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:24 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38" returned: 0 in 0.687s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89571c9a-9374-42bd-b293-8245409cf0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97fe302-35b4-4611-9788-ad4d25dd8f38', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5278cd-a422-41f4-a98e-9e62015ad111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Volume volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 (a97fe302-35b4-4611-9788-ad4d25dd8f38): created successfully Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5278cd-a422-41f4-a98e-9e62015ad111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Flow 'volume_create_manager' (a4ad5078-f6f4-4c67-b68b-031b1d80b453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-12b1016d-383b-4b98-b345-e8f774d679d8 tempest-VolumesTransfersV355Test-1338611615 None] Created volume successfully. Jul 09 01:21:25 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:25 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Deleted volume successfully. Jul 09 01:21:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-30bb5691-495b-49b5-a8af-f5a9b8a50a01 tempest-VolumesMetadataTest-998852422 None] Lock "cinder-59cdc2ea-6e41-4bd9-8c0f-9bcdca6ebd0f-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e4d1ad04-5547-4118-9c9b-422e4098bf2e tempest-VolumesTransfersV355Test-125323036 None] Transfer volume completed successfully. Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "cinder-a97fe302-35b4-4611-9788-ad4d25dd8f38-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-a97fe302-35b4-4611-9788-ad4d25dd8f38-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "cinder-quobyte-a97fe302-35b4-4611-9788-ad4d25dd8f38" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-quobyte-a97fe302-35b4-4611-9788-ad4d25dd8f38" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[886bfc25-e2c7-4866-86cc-433f7e122cca]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:28 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 Jul 09 01:21:28 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:29 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38" returned: 0 in 0.926s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:29 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38 Jul 09 01:21:29 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Flow 'volume_create_manager' (bbeb2717-60d3-4ad2-94dc-62d78f650051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1a4d5-8c19-44f7-838e-6a6ec9162077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1a4d5-8c19-44f7-838e-6a6ec9162077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469245788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c510a331-120a-4131-ad13-ba1a3cf6a689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf9bf4207af406b9e5ff0b054fdd262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:30Z,use_quota=True,user_id='e74a6b48cd7741a6a8b9f2393f81ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730b2aca-324e-42ed-94b0-a058bec567f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730b2aca-324e-42ed-94b0-a058bec567f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8406dec9-a233-42b2-814d-5e3bfd864829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8406dec9-a233-42b2-814d-5e3bfd864829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c510a331-120a-4131-ad13-ba1a3cf6a689', 'volume_name': 'volume-c510a331-120a-4131-ad13-ba1a3cf6a689', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c3530-dc36-4e07-847a-34bef2883c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c3530-dc36-4e07-847a-34bef2883c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca7df5-ab42-4b82-8310-47a0eba58d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Volume c510a331-120a-4131-ad13-ba1a3cf6a689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c510a331-120a-4131-ad13-ba1a3cf6a689', 'volume_size': 1} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469245788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c510a331-120a-4131-ad13-ba1a3cf6a689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf9bf4207af406b9e5ff0b054fdd262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:30Z,use_quota=True,user_id='e74a6b48cd7741a6a8b9f2393f81ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Creating volume c510a331-120a-4131-ad13-ba1a3cf6a689 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:30 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:30 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 1073741824 Jul 09 01:21:30 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:30 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a97fe302-35b4-4611-9788-ad4d25dd8f38" returned: 0 in 0.838s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-quobyte-a97fe302-35b4-4611-9788-ad4d25dd8f38" released by "delete_volume" :: held 1.840s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (61aac0df-f54f-4eb8-92da-c8245b407481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c23177-5681-474c-83ed-a6093f9a287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c23177-5681-474c-83ed-a6093f9a287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349426014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1801bdfd-56b2-4f68-ba94-ba853182e85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:30Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f88f139-7b5d-4b52-8d13-11e9406d95ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f88f139-7b5d-4b52-8d13-11e9406d95ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e4c696-9d77-4c26-9bb6-0ffa53d441d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e4c696-9d77-4c26-9bb6-0ffa53d441d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1801bdfd-56b2-4f68-ba94-ba853182e85c', 'volume_name': 'volume-1801bdfd-56b2-4f68-ba94-ba853182e85c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caca7dae-313e-4826-ad74-54e49b04a97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caca7dae-313e-4826-ad74-54e49b04a97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab524-d585-4602-8ff7-7d1f3f3c3650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Volume 1801bdfd-56b2-4f68-ba94-ba853182e85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1801bdfd-56b2-4f68-ba94-ba853182e85c', 'volume_size': 1} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Created reservations ['059ceacc-7716-4f4c-a07c-9b26d85ffed3', '3e825de4-07c1-4b45-bb6f-756501cd5f44', '1cb832d7-521a-45de-8e98-fe77a34d3c10', '2727c3c9-084f-4f83-853a-c25d841c2094'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:30 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:30 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:31 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 1073741824" returned: 0 in 0.934s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:31 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 Jul 09 01:21:31 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:31 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Deleted volume successfully. Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Flow 'volume_create_manager' (7cd926df-85b3-4603-9598-f85f510dcf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e956e24c-3d20-4ff4-a998-87e89a363a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-737aa3f8-b108-4dcd-8e26-2fa4867b63c3 tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-a97fe302-35b4-4611-9788-ad4d25dd8f38-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e956e24c-3d20-4ff4-a998-87e89a363a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864674384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe80759b-5865-46aa-88aa-1cf48eb76834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd691f8f34a64a2fa834842c9b074c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:31Z,use_quota=True,user_id='101c3b10c89446d18f6161822422b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd18317d-e137-4904-b7e7-23083197f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd18317d-e137-4904-b7e7-23083197f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133dacb7-3e38-4168-9b76-27d38385f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133dacb7-3e38-4168-9b76-27d38385f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe80759b-5865-46aa-88aa-1cf48eb76834', 'volume_name': 'volume-fe80759b-5865-46aa-88aa-1cf48eb76834', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a6d370-345e-4fe9-9dce-8c7fc82bc8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a6d370-345e-4fe9-9dce-8c7fc82bc8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0835d96e-d5c0-4d91-b07a-0c0afe206c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Volume fe80759b-5865-46aa-88aa-1cf48eb76834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe80759b-5865-46aa-88aa-1cf48eb76834', 'volume_size': 1} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:31 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689" returned: 0 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349426014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1801bdfd-56b2-4f68-ba94-ba853182e85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:30Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Creating volume 1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:31 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca7df5-ab42-4b82-8310-47a0eba58d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c510a331-120a-4131-ad13-ba1a3cf6a689', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c 1073741824 Jul 09 01:21:31 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f14fa1-3f35-4569-810f-18b9c87dc73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:31 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Volume volume-c510a331-120a-4131-ad13-ba1a3cf6a689 (c510a331-120a-4131-ad13-ba1a3cf6a689): created successfully Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f14fa1-3f35-4569-810f-18b9c87dc73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Flow 'volume_create_manager' (bbeb2717-60d3-4ad2-94dc-62d78f650051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2130406d-58f0-49c6-9df7-ebf7517a1d62 tempest-VolumesTransfersV357Test-147914794 None] Created volume successfully. Jul 09 01:21:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4d273539-8f1b-4025-a645-835fc2ad6fb9 tempest-VolumesTransfersV357Test-2076893797 None] Transfer volume completed successfully. Jul 09 01:21:32 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c 1073741824" returned: 0 in 0.883s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:32 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c Jul 09 01:21:32 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:33 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.121s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864674384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe80759b-5865-46aa-88aa-1cf48eb76834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd691f8f34a64a2fa834842c9b074c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:31Z,use_quota=True,user_id='101c3b10c89446d18f6161822422b07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Creating volume fe80759b-5865-46aa-88aa-1cf48eb76834 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:33 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab524-d585-4602-8ff7-7d1f3f3c3650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1801bdfd-56b2-4f68-ba94-ba853182e85c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:33 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 1073741824 Jul 09 01:21:33 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cc4f47-83a6-44a1-b91f-7c95451a9c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Volume volume-1801bdfd-56b2-4f68-ba94-ba853182e85c (1801bdfd-56b2-4f68-ba94-ba853182e85c): created successfully Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cc4f47-83a6-44a1-b91f-7c95451a9c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (61aac0df-f54f-4eb8-92da-c8245b407481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3c9d92c2-25fc-41d5-97c3-efdf1e64af6d tempest-VolumesSnapshotTestJSON-722866701 None] Created volume successfully. Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "cinder-c510a331-120a-4131-ad13-ba1a3cf6a689-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-c510a331-120a-4131-ad13-ba1a3cf6a689-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "cinder-quobyte-c510a331-120a-4131-ad13-ba1a3cf6a689" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-quobyte-c510a331-120a-4131-ad13-ba1a3cf6a689" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd3ee1-7f67-4d88-b282-f9eea039c7d1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:33 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:33 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:33 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 Jul 09 01:21:33 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:34 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 1073741824" returned: 0 in 0.866s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=92,cinder:UPDATE=110,cinder:DELETE=11,cinder:INSERT=33 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=94,cinder:UPDATE=109,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:34 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 Jul 09 01:21:34 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:34 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.734s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:21:34 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689" returned: 0 in 0.880s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:34 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689 Jul 09 01:21:34 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:35 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.348s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0835d96e-d5c0-4d91-b07a-0c0afe206c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe80759b-5865-46aa-88aa-1cf48eb76834', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23224ee7-0c83-4a06-b5d4-3ff217962579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Creating offline snapshot af8827cc-a78b-49fc-b6e8-959e3ba05bae of volume 1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:21:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Volume volume-fe80759b-5865-46aa-88aa-1cf48eb76834 (fe80759b-5865-46aa-88aa-1cf48eb76834): created successfully Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23224ee7-0c83-4a06-b5d4-3ff217962579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Flow 'volume_create_manager' (7cd926df-85b3-4603-9598-f85f510dcf36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3a1bf-48e5-4752-aaf4-7039b7a26471]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b8e6d12e-052a-4e6f-aacf-3b9fa14ea8bd tempest-VolumesTransfersV355Test-1338611615 None] Created volume successfully. Jul 09 01:21:35 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c Jul 09 01:21:35 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:35 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c510a331-120a-4131-ad13-ba1a3cf6a689" returned: 0 in 0.805s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-quobyte-c510a331-120a-4131-ad13-ba1a3cf6a689" released by "delete_volume" :: held 1.744s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Created reservations ['f65c97c3-082a-43e5-8dfa-98896354a26a', '94d9d491-5ff5-4d98-9c57-ed5db1c16413', 'e2078c50-ac82-4883-a06b-69ce69f6aabe', '519901a8-64af-4351-96ef-6bc9f3303eb7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:35 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:35 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "cinder-fe80759b-5865-46aa-88aa-1cf48eb76834-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-fe80759b-5865-46aa-88aa-1cf48eb76834-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "cinder-quobyte-fe80759b-5865-46aa-88aa-1cf48eb76834" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-quobyte-fe80759b-5865-46aa-88aa-1cf48eb76834" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cece74-44aa-4209-afaf-ee2f84cd16a8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:36 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 Jul 09 01:21:36 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:36 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c" returned: 0 in 1.024s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:36 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae 1G Jul 09 01:21:36 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:36 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.868s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Deleted volume successfully. Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c97e9350-1d44-4a7e-a7dc-20fcb35cbbdb tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-c510a331-120a-4131-ad13-ba1a3cf6a689-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Flow 'volume_create_manager' (7832b535-2299-4c74-a8a5-26317432ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62e07a7-814d-40c8-bbee-7a620c552ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62e07a7-814d-40c8-bbee-7a620c552ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-979057689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf9bf4207af406b9e5ff0b054fdd262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:37Z,use_quota=True,user_id='e74a6b48cd7741a6a8b9f2393f81ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6006decf-68b1-46a7-9b2e-914c16920558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6006decf-68b1-46a7-9b2e-914c16920558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebe332d-d137-4402-a2bc-095d6a1d3bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebe332d-d137-4402-a2bc-095d6a1d3bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571', 'volume_name': 'volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ca12e-3b3e-4dd1-bc22-b8045f3a542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ca12e-3b3e-4dd1-bc22-b8045f3a542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6172a0f-7843-48d6-be62-5347c294a13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Volume b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571', 'volume_size': 1} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:36 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834" returned: 0 in 0.928s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:36 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834 Jul 09 01:21:36 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:37 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae 1G" returned: 0 in 0.977s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801bdfd-56b2-4f68-ba94-ba853182e85c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:37 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801bdfd-56b2-4f68-ba94-ba853182e85c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae Jul 09 01:21:37 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:37 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fe80759b-5865-46aa-88aa-1cf48eb76834" returned: 0 in 0.704s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-quobyte-fe80759b-5865-46aa-88aa-1cf48eb76834" released by "delete_volume" :: held 1.676s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Created reservations ['ad1c6c5b-3ca6-4d8c-9408-1f661df7612e', '3fb1c5df-187d-4384-8ac9-5f48b048269c', 'bccf4ebd-eb3d-47b7-8a42-ceee2a172c64', '38003f1a-2de8-4463-aa77-06bc7678dd9c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:37 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:37 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:37 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1801bdfd-56b2-4f68-ba94-ba853182e85c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae" returned: 0 in 0.707s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:37 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae is being set with open permissions: ugo+rw Jul 09 01:21:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:38 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae Jul 09 01:21:38 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:38 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:38 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Deleted volume successfully. Jul 09 01:21:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-3492b018-4b2f-44f6-be64-608c6a914d4a tempest-VolumesTransfersV355Test-468170780 None] Lock "cinder-fe80759b-5865-46aa-88aa-1cf48eb76834-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:38 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae" returned: 0 in 0.706s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:38 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info Jul 09 01:21:38 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:39 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info" returned: 0 in 0.667s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:39 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info is being set with open permissions: ugo+rw Jul 09 01:21:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:39 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info Jul 09 01:21:39 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:40 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.info" returned: 0 in 0.720s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.959s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.367s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-979057689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf9bf4207af406b9e5ff0b054fdd262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:37Z,use_quota=True,user_id='e74a6b48cd7741a6a8b9f2393f81ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Creating volume b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:40 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:40 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 1073741824 Jul 09 01:21:40 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:40 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-af19d73d-b687-4c11-98a6-975eb6aab169 tempest-VolumesSnapshotTestJSON-722866701 None] Create snapshot completed successfully Jul 09 01:21:41 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 1073741824" returned: 0 in 0.940s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:41 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 Jul 09 01:21:41 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-af8827cc-a78b-49fc-b6e8-959e3ba05bae-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-af8827cc-a78b-49fc-b6e8-959e3ba05bae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-af8827cc-a78b-49fc-b6e8-959e3ba05bae" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-af8827cc-a78b-49fc-b6e8-959e3ba05bae" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Deleting offline snapshot af8827cc-a78b-49fc-b6e8-959e3ba05bae of volume 1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] snapshot_file for this snap is: volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6671e74-d5ff-491c-b77e-1228eabac07a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:41 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae Jul 09 01:21:41 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:41 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" returned: 0 in 0.725s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6172a0f-7843-48d6-be62-5347c294a13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6997d5a2-f240-459d-893a-7187d374eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Volume volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 (b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571): created successfully Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6997d5a2-f240-459d-893a-7187d374eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Flow 'volume_create_manager' (7832b535-2299-4c74-a8a5-26317432ed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1bdf2670-fb84-4036-93d2-029acf4f7908 tempest-VolumesTransfersV357Test-147914794 None] Created volume successfully. Jul 09 01:21:42 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1801bdfd-56b2-4f68-ba94-ba853182e85c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:21:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1105ad-2c68-47a2-9063-9c264a6e2901]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:42 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c Jul 09 01:21:42 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:43 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c" returned: 0 in 0.823s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:43 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae Jul 09 01:21:43 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "cinder-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "cinder-quobyte-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-quobyte-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e0c5b-5c9c-44d5-9867-41a97be2d70a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:43 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 Jul 09 01:21:43 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Flow 'volume_create_manager' (8b418d2a-fcf7-495d-98f7-45fe8f95ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3880155-612d-48c0-926a-ae5075d18fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3880155-612d-48c0-926a-ae5075d18fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-331103976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a081862-88b0-4518-800d-4a695e777f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f9214dfd4cb4917979bd7edf3990321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:44Z,use_quota=True,user_id='3d8db806a4e34fcd8d6e2f24a6282851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd6b781-8c63-45c2-8203-8812b55d0089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd6b781-8c63-45c2-8203-8812b55d0089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229b1285-cae6-4a7e-8c59-2f2571bd9f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229b1285-cae6-4a7e-8c59-2f2571bd9f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a081862-88b0-4518-800d-4a695e777f2c', 'volume_name': 'volume-3a081862-88b0-4518-800d-4a695e777f2c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d134a4d0-5383-49ba-bcbe-36c4e84e8033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d134a4d0-5383-49ba-bcbe-36c4e84e8033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb942e-f2e4-4ef6-82d3-c2017d4f0eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Volume 3a081862-88b0-4518-800d-4a695e777f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a081862-88b0-4518-800d-4a695e777f2c', 'volume_size': 1} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-331103976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a081862-88b0-4518-800d-4a695e777f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f9214dfd4cb4917979bd7edf3990321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:44Z,use_quota=True,user_id='3d8db806a4e34fcd8d6e2f24a6282851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Creating volume 3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:43 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:43 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae" returned: 0 in 0.855s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:43 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c 1073741824 Jul 09 01:21:43 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:43 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae Jul 09 01:21:43 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:44 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:44 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571 Jul 09 01:21:44 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:44 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c.af8827cc-a78b-49fc-b6e8-959e3ba05bae" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-af8827cc-a78b-49fc-b6e8-959e3ba05bae" released by "_delete_snapshot" :: held 3.316s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" released by "delete_snapshot" :: held 3.392s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['ca799662-a204-4f43-9c50-5e4943724bb9', '3a2666b0-fbbc-4cb0-a3df-2f3eaf36529b', 'eaf8443e-d89c-4138-bc8a-b0c8bf2975ad', '73f6f3e6-eae7-4a4b-b968-7c2437f96fcc'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Delete snapshot completed successfully. Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7449177a-c3ad-4a5e-b4af-fb5ff1f90ec8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-af8827cc-a78b-49fc-b6e8-959e3ba05bae-delete_snapshot" released by "delete_snapshot" :: held 3.597s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:44 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c 1073741824" returned: 0 in 0.965s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:44 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" returned: 0 in 0.754s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:44 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:21:44 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-quobyte-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571" released by "delete_volume" :: held 1.627s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Created reservations ['3fbc7377-0c08-4ce3-a17b-26c1b590c351', '0d0dd3bc-756a-4d21-b89e-4a9a3237c9ea', '96ae12db-a752-446e-b5a7-63148b80edea', 'dd5efcc1-6fb1-42c0-a1ea-c6f5eb5217ed'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:45 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:21:45 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:45 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb942e-f2e4-4ef6-82d3-c2017d4f0eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a081862-88b0-4518-800d-4a695e777f2c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f2903b-fe3f-4452-93cd-81c1766dadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:45 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Volume volume-3a081862-88b0-4518-800d-4a695e777f2c (3a081862-88b0-4518-800d-4a695e777f2c): created successfully Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f2903b-fe3f-4452-93cd-81c1766dadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Flow 'volume_create_manager' (8b418d2a-fcf7-495d-98f7-45fe8f95ec22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3e1a78b3-2f0b-45aa-8792-23994a378fab tempest-VolumesCloneTest-1139332713 None] Created volume successfully. Jul 09 01:21:45 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:21:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Deleted volume successfully. Jul 09 01:21:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-019a59ef-f1f9-455d-812b-f0ed45cbe25b tempest-VolumesTransfersV357Test-599868043 None] Lock "cinder-b6bc6f2b-fdbb-4d4b-9fe5-71ade89bf571-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (e09341b8-2a82-4378-9108-1db60c45dc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea9e0cc-a4f3-43ab-92ca-c4fb986a51c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea9e0cc-a4f3-43ab-92ca-c4fb986a51c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b27c6fe-da18-4778-ab65-fd683f74b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:46Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894d5ee5-5cf6-4336-bd62-a743a840843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894d5ee5-5cf6-4336-bd62-a743a840843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3262692e-d813-4197-a05f-ed3208d528b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3262692e-d813-4197-a05f-ed3208d528b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b27c6fe-da18-4778-ab65-fd683f74b506', 'volume_name': 'volume-5b27c6fe-da18-4778-ab65-fd683f74b506', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f79cfb-4536-4ec8-92b8-328fcfc83247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f79cfb-4536-4ec8-92b8-328fcfc83247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5717a9d1-761b-42fd-8fca-4dae377d98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Volume 5b27c6fe-da18-4778-ab65-fd683f74b506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b27c6fe-da18-4778-ab65-fd683f74b506', 'volume_size': 1} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b27c6fe-da18-4778-ab65-fd683f74b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:46Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Creating volume 5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:21:46 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:46 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 1073741824 Jul 09 01:21:46 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Flow 'volume_create_manager' (8f039e87-e74b-48c7-be4f-c7184b76325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc8e6f-8b09-4e3a-8e89-e2a794564e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc8e6f-8b09-4e3a-8e89-e2a794564e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1641529026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d192f9-ae6f-4ceb-9837-4fa9c4ce397f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f9214dfd4cb4917979bd7edf3990321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3a081862-88b0-4518-800d-4a695e777f2c,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:46Z,use_quota=True,user_id='3d8db806a4e34fcd8d6e2f24a6282851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0537cc94-5143-4967-bd7e-d6590aca0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0537cc94-5143-4967-bd7e-d6590aca0696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f934f9e6-7251-4240-a699-a3e1391492eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f934f9e6-7251-4240-a699-a3e1391492eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '50d192f9-ae6f-4ceb-9837-4fa9c4ce397f', 'volume_name': 'volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f', 'volume_size': 2, 'source_volid': '3a081862-88b0-4518-800d-4a695e777f2c', 'source_volstatus': 'available'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37301cf-9f29-4349-b09c-bbad1cf69a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37301cf-9f29-4349-b09c-bbad1cf69a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf2a2ef-3e0c-4e60-98c2-2241b5e6ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Volume 50d192f9-ae6f-4ceb-9837-4fa9c4ce397f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f', 'volume_size': 2, 'source_volid': '3a081862-88b0-4518-800d-4a695e777f2c', 'source_volstatus': 'available'} Jul 09 01:21:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:47 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 1073741824" returned: 0 in 0.949s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:47 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:21:47 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:48 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.716s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.373s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:48 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Cloning volume 3a081862-88b0-4518-800d-4a695e777f2c to volume 50d192f9-ae6f-4ceb-9837-4fa9c4ce397f Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5717a9d1-761b-42fd-8fca-4dae377d98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b27c6fe-da18-4778-ab65-fd683f74b506', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc7fcb-0e9f-43fb-96ad-91d000033fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:48 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Volume volume-5b27c6fe-da18-4778-ab65-fd683f74b506 (5b27c6fe-da18-4778-ab65-fd683f74b506): created successfully Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc7fcb-0e9f-43fb-96ad-91d000033fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (e09341b8-2a82-4378-9108-1db60c45dc73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Creating offline snapshot 5a72687c-e1db-4617-95b7-895c3ebd6e0e of volume 3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852f579-b245-4c7b-bd59-51de7711b94e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-df7ea270-db6b-4662-af26-734854be2824 tempest-VolumesSnapshotTestJSON-722866701 None] Created volume successfully. Jul 09 01:21:48 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:21:48 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:48 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:49 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e 1G Jul 09 01:21:49 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:49 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e 1G" returned: 0 in 0.908s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a081862-88b0-4518-800d-4a695e777f2c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:49 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a081862-88b0-4518-800d-4a695e777f2c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:21:49 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:50 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a081862-88b0-4518-800d-4a695e777f2c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.716s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:50 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e is being set with open permissions: ugo+rw Jul 09 01:21:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:50 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:21:50 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:51 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.687s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:21:51 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info Jul 09 01:21:51 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (8a3905b9-fe3c-4203-8af2-f5e5ef3bd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c123d0d-7514-478c-b9bc-dfbc855c7195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c123d0d-7514-478c-b9bc-dfbc855c7195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170894527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a98fb5-9b30-453e-87e2-d7894e82ecc3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:51Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6964e03-79ae-4c6b-9bef-b006c971fdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6964e03-79ae-4c6b-9bef-b006c971fdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c847f3-c100-468a-a4f8-cd3ad40f94fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c847f3-c100-468a-a4f8-cd3ad40f94fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a98fb5-9b30-453e-87e2-d7894e82ecc3', 'volume_name': 'volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43588c2-c215-43d8-9798-7649783e8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43588c2-c215-43d8-9798-7649783e8747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98365ae8-163c-4599-8971-37de00da1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:21:51 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Volume 70a98fb5-9b30-453e-87e2-d7894e82ecc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3', 'volume_size': 1} Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:51 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info" returned: 0 in 0.634s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:51 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info is being set with open permissions: ugo+rw Jul 09 01:21:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:52 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info Jul 09 01:21:52 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:52 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.info" returned: 0 in 0.625s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] snapshot: 5a72687c-e1db-4617-95b7-895c3ebd6e0e, volume: 50d192f9-ae6f-4ceb-9837-4fa9c4ce397f, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[796fac93-3686-4eff-b307-6313e342a837]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:52 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:21:52 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:53 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a081862-88b0-4518-800d-4a695e777f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2f99ac-c136-411a-852c-dbd4c9596503]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:53 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:21:53 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:54 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.773s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:54 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:21:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:54 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f Jul 09 01:21:54 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:58 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" returned: 0 in 4.546s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7822449-c660-426a-9f7c-f58c787b7474]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:21:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:58 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:21:58 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:21:59 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 09 01:21:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.948s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:21:59 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:21:59 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Converted 1024.00 MB image at 225.19 MB/s Jul 09 01:21:59 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f is being set with open permissions: ugo+rw Jul 09 01:21:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:21:59 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f Jul 09 01:21:59 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:00 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" released by "_copy_volume_from_snapshot" :: held 7.749s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-quobyte-5a72687c-e1db-4617-95b7-895c3ebd6e0e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-5a72687c-e1db-4617-95b7-895c3ebd6e0e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Deleting offline snapshot 5a72687c-e1db-4617-95b7-895c3ebd6e0e of volume 3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] snapshot_file for this snap is: volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5c2fc4-4ef5-40d9-8dba-53c02fad72d7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:00 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:22:00 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:01 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.765s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a081862-88b0-4518-800d-4a695e777f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d2706-2db7-44ca-8cdb-21370b1e0c9f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:01 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:22:01 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=49,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:22:01 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.744s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:02 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:22:02 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:02 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.758s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:02 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e Jul 09 01:22:02 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:03 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c.5a72687c-e1db-4617-95b7-895c3ebd6e0e" returned: 0 in 0.635s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-5a72687c-e1db-4617-95b7-895c3ebd6e0e" released by "_delete_snapshot" :: held 2.985s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.382s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.935s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Creating offline snapshot 75359aaf-9817-4313-a206-cbce863978f9 of volume 5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf2a2ef-3e0c-4e60-98c2-2241b5e6ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f', 'volume_size': 2, 'source_volid': '3a081862-88b0-4518-800d-4a695e777f2c', 'source_volstatus': 'available'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b91134-51b3-431c-a9cf-b1a1fe224cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef829423-aaa9-4d91-8f96-d073930febf6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Volume volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f (50d192f9-ae6f-4ceb-9837-4fa9c4ce397f): created successfully Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b91134-51b3-431c-a9cf-b1a1fe224cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Flow 'volume_create_manager' (8f039e87-e74b-48c7-be4f-c7184b76325e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c03911a2-f387-43a1-82d6-2a4d7d5a9ebc tempest-VolumesCloneTest-1139332713 None] Created volume successfully. Jul 09 01:22:03 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:03 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "cinder-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362180d-a65b-43d1-8dbd-3afa1ca4fca4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:04 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f Jul 09 01:22:04 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:04 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.823s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:04 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 1G Jul 09 01:22:04 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:04 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" returned: 0 in 0.782s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:04 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f Jul 09 01:22:04 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:05 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 1G" returned: 0 in 0.853s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b27c6fe-da18-4778-ab65-fd683f74b506 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:05 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b27c6fe-da18-4778-ab65-fd683f74b506 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:05 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:05 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f" released by "delete_volume" :: held 1.499s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Created reservations ['98770ef3-de65-454c-8729-525a87b34a05', '279b2c49-cd80-4789-8b17-2723a1b9b825', '563bb62d-e84a-41af-b904-726e03070005', '372569be-2dc5-41bb-9244-196ec2b26467'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:05 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:05 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:05 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b27c6fe-da18-4778-ab65-fd683f74b506 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.717s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:05 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 is being set with open permissions: ugo+rw Jul 09 01:22:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:05 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:05 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-3a081862-88b0-4518-800d-4a695e777f2c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:06 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.661s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "cinder-3a081862-88b0-4518-800d-4a695e777f2c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Deleted volume successfully. Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-817c40d1-9361-40cf-b32b-7cbb242aa8ee tempest-VolumesCloneTest-1139332713 None] Lock "cinder-50d192f9-ae6f-4ceb-9837-4fa9c4ce397f-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Acquiring lock "cinder-quobyte-3a081862-88b0-4518-800d-4a695e777f2c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-3a081862-88b0-4518-800d-4a695e777f2c" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d084809-321b-4146-adbb-1ab0fa03f6a7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:06 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:22:06 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:06 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:06 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info Jul 09 01:22:06 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:07 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.771s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:07 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c Jul 09 01:22:07 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:07 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info" returned: 0 in 0.637s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:07 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info is being set with open permissions: ugo+rw Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:07 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info Jul 09 01:22:07 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:07 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3a081862-88b0-4518-800d-4a695e777f2c" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "cinder-quobyte-3a081862-88b0-4518-800d-4a695e777f2c" released by "delete_volume" :: held 1.513s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:07 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.info" returned: 0 in 0.636s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.440s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170894527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a98fb5-9b30-453e-87e2-d7894e82ecc3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:21:51Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Creating volume 70a98fb5-9b30-453e-87e2-d7894e82ecc3 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:07 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Created reservations ['6d9f56ea-1854-4277-b917-857c1fadcd6a', '6c6f2655-29be-4d7c-abb3-5572f7f21399', 'dc2ee948-a95d-41b2-b817-dd296389eb8d', '3455244e-2fdc-4f48-bb37-15df06ad9fc6'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:07 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 1073741824 Jul 09 01:22:07 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d9682625-47d9-4d9b-9fbd-5e86ae19b476 tempest-VolumesSnapshotTestJSON-722866701 None] Create snapshot completed successfully Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:08 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:08 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:08 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.822s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:08 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Deleted volume successfully. Jul 09 01:22:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53f1b16b-3263-4077-bbda-7053002bec35 tempest-VolumesCloneTest-1139332713 None] Lock "cinder-3a081862-88b0-4518-800d-4a695e777f2c-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:08 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 1073741824" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:09 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 Jul 09 01:22:09 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (2b90ae2a-23be-41cf-8c65-4ccf7b431394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bce595-f3e7-4ea7-ac7a-cc00f2ae3cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bce595-f3e7-4ea7-ac7a-cc00f2ae3cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790415646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d71721a-7595-4f5d-9678-854a3373124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=75359aaf-9817-4313-a206-cbce863978f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:09Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc97f2a-f0bb-44eb-8c80-8a18669d2e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc97f2a-f0bb-44eb-8c80-8a18669d2e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a537a2-cce3-4a2d-8745-4e673dea6b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a537a2-cce3-4a2d-8745-4e673dea6b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d71721a-7595-4f5d-9678-854a3373124b', 'volume_name': 'volume-3d71721a-7595-4f5d-9678-854a3373124b', 'volume_size': 2, 'snapshot_id': '75359aaf-9817-4313-a206-cbce863978f9'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb06acd7-cb88-4ba4-a411-ab268f0b2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb06acd7-cb88-4ba4-a411-ab268f0b2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27327b25-3598-4246-84b2-123fabc1d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Volume 3d71721a-7595-4f5d-9678-854a3373124b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d71721a-7595-4f5d-9678-854a3373124b', 'volume_size': 2, 'snapshot_id': '75359aaf-9817-4313-a206-cbce863978f9'} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:09 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.605s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9-3d71721a-7595-4f5d-9678-854a3373124b" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98365ae8-163c-4599-8971-37de00da1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cb3f9d-1f6a-49f9-a492-2997f65a9d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9-3d71721a-7595-4f5d-9678-854a3373124b" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Creating volume 3d71721a-7595-4f5d-9678-854a3373124b from snapshot 75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Volume volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 (70a98fb5-9b30-453e-87e2-d7894e82ecc3): created successfully Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cb3f9d-1f6a-49f9-a492-2997f65a9d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (8a3905b9-fe3c-4203-8af2-f5e5ef3bd508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] snapshot: 75359aaf-9817-4313-a206-cbce863978f9, volume: 3d71721a-7595-4f5d-9678-854a3373124b, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1785ff94-65d8-4ed6-a99c-52e7ca4d4441 tempest-VolumesListTestJSON-2071439330 None] Created volume successfully. Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d87c84-9a4f-4c05-b9c3-25acbb5b10e4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:10 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:10 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:10 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b27c6fe-da18-4778-ab65-fd683f74b506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a7d10-4e03-4dcf-b47e-df4c9a7d1c49]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:10 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:10 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (64097827-a7d2-439d-b09d-fe6a04df9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efeed6f7-7db7-40bc-8e58-8934b7977d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efeed6f7-7db7-40bc-8e58-8934b7977d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1793649828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7544ea4-8381-4c31-ae40-9ab223b286df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:11Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ab70e1-5053-42c4-aecd-2731097b2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ab70e1-5053-42c4-aecd-2731097b2648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f950683-9be4-4ad0-8e78-aacb3d48d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f950683-9be4-4ad0-8e78-aacb3d48d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7544ea4-8381-4c31-ae40-9ab223b286df', 'volume_name': 'volume-c7544ea4-8381-4c31-ae40-9ab223b286df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ecff4f-bfd9-4b90-838f-17f0fd19ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ecff4f-bfd9-4b90-838f-17f0fd19ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976fc2dd-2c66-4a63-9087-6235e1109954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Volume c7544ea4-8381-4c31-ae40-9ab223b286df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7544ea4-8381-4c31-ae40-9ab223b286df', 'volume_size': 1} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:11 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.817s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:11 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b Jul 09 01:22:11 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (5de24fcd-f9e8-4f3f-9c28-d4fd55ca9639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4e1b55-22c6-4f8a-925f-0a259b4cf869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4e1b55-22c6-4f8a-925f-0a259b4cf869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-682726804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e8e652-d93c-4e1f-af0b-af3f0cee3e3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:12Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c50675b-49f1-4bb9-b8f2-24a76debb424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c50675b-49f1-4bb9-b8f2-24a76debb424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132c6531-815d-4b7b-91ba-d9f347d6b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132c6531-815d-4b7b-91ba-d9f347d6b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e8e652-d93c-4e1f-af0b-af3f0cee3e3f', 'volume_name': 'volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64149a1-3635-4b70-a388-a31437cdd34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64149a1-3635-4b70-a388-a31437cdd34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c23be-4e65-4673-8afc-d3447b9318d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Volume 61e8e652-d93c-4e1f-af0b-af3f0cee3e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f', 'volume_size': 1} Jul 09 01:22:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:16 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b" returned: 0 in 4.640s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:16 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecea70d-331b-4d2f-bcda-0990e6c508ff]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:16 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:16 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:17 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.932s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:22:17 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Converted 1024.00 MB image at 220.64 MB/s Jul 09 01:22:17 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b is being set with open permissions: ugo+rw Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:17 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b Jul 09 01:22:17 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:17 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b" returned: 0 in 0.635s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" released by "_copy_volume_from_snapshot" :: held 7.978s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9-3d71721a-7595-4f5d-9678-854a3373124b" released by "_create_volume_from_snapshot" :: held 8.034s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.064s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.369s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1793649828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7544ea4-8381-4c31-ae40-9ab223b286df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:11Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Creating volume c7544ea4-8381-4c31-ae40-9ab223b286df {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:17 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df 1073741824 Jul 09 01:22:17 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27327b25-3598-4246-84b2-123fabc1d912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d71721a-7595-4f5d-9678-854a3373124b', 'volume_size': 2, 'snapshot_id': '75359aaf-9817-4313-a206-cbce863978f9'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85de86b8-c032-4b51-990b-7afd57d8e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:17 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Volume volume-3d71721a-7595-4f5d-9678-854a3373124b (3d71721a-7595-4f5d-9678-854a3373124b): created successfully Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85de86b8-c032-4b51-990b-7afd57d8e848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (2b90ae2a-23be-41cf-8c65-4ccf7b431394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5cdce7bb-9da2-4ac9-8971-a779558fc695 tempest-VolumesSnapshotTestJSON-722866701 None] Created volume successfully. Jul 09 01:22:18 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df 1073741824" returned: 0 in 0.797s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:18 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df Jul 09 01:22:18 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-3d71721a-7595-4f5d-9678-854a3373124b-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-3d71721a-7595-4f5d-9678-854a3373124b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[837d8b9a-e453-471f-9dd0-9d5abdf8b65f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:19 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b Jul 09 01:22:19 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:19 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df" returned: 0 in 0.664s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.460s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-682726804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e8e652-d93c-4e1f-af0b-af3f0cee3e3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:12Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Creating volume 61e8e652-d93c-4e1f-af0b-af3f0cee3e3f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:19 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976fc2dd-2c66-4a63-9087-6235e1109954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7544ea4-8381-4c31-ae40-9ab223b286df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:19 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f 1073741824 Jul 09 01:22:19 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f91cd6d-bf11-4a0c-b7fc-e01608e385c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Volume volume-c7544ea4-8381-4c31-ae40-9ab223b286df (c7544ea4-8381-4c31-ae40-9ab223b286df): created successfully Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f91cd6d-bf11-4a0c-b7fc-e01608e385c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (64097827-a7d2-439d-b09d-fe6a04df9418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-608f2ca3-8299-45f5-8f82-11fff831cf31 tempest-VolumesListTestJSON-2071439330 None] Created volume successfully. Jul 09 01:22:19 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b" returned: 0 in 0.788s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:19 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b Jul 09 01:22:19 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:20 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f 1073741824" returned: 0 in 0.961s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:20 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f Jul 09 01:22:20 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:20 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3d71721a-7595-4f5d-9678-854a3373124b" returned: 0 in 0.740s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-3d71721a-7595-4f5d-9678-854a3373124b" released by "delete_volume" :: held 1.579s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['8fcdb4c7-1f4e-446c-a5dc-31d866889d8b', '8835091c-1999-4792-b4f4-d0e0f83cbee4', '2d4830c8-fe58-42c5-9d3a-be666258f35e', 'b501c213-7e29-477a-931e-1993a10b5cfc'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:20 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:20 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (918dfcd9-c240-4abc-b8de-1a925c5a3dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc3e36f-6f1b-49be-aa16-7efef0ab68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc3e36f-6f1b-49be-aa16-7efef0ab68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1008261766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfdf39f-707c-42c0-beca-b0733ca3b1b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:21Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3eb13e-e36b-4b69-bb41-f36684013f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3eb13e-e36b-4b69-bb41-f36684013f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0513d9d9-5e4a-42dd-aa5d-3be964e490f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0513d9d9-5e4a-42dd-aa5d-3be964e490f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfdf39f-707c-42c0-beca-b0733ca3b1b8', 'volume_name': 'volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4383a-b368-4b1a-ad51-ab4d096d4fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4383a-b368-4b1a-ad51-ab4d096d4fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a52cba-b000-4bcb-a13c-7e18ffbb24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Volume 3bfdf39f-707c-42c0-beca-b0733ca3b1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8', 'volume_size': 1} Jul 09 01:22:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:21 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1008261766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfdf39f-707c-42c0-beca-b0733ca3b1b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce40d42689e4c8d97ad9c08d570ba2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:21Z,use_quota=True,user_id='6bb24e0c53b94c2c8af418a6db08cd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Creating volume 3bfdf39f-707c-42c0-beca-b0733ca3b1b8 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:21 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c23be-4e65-4673-8afc-d3447b9318d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:21 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 1073741824 Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3947a1-48a1-4c27-aa92-2a8593385850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:21 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-75359aaf-9817-4313-a206-cbce863978f9-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Volume volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f (61e8e652-d93c-4e1f-af0b-af3f0cee3e3f): created successfully Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3947a1-48a1-4c27-aa92-2a8593385850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (5de24fcd-f9e8-4f3f-9c28-d4fd55ca9639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-75359aaf-9817-4313-a206-cbce863978f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-28b2a0f1-532b-4171-b9f1-0d499e0a5339 tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Deleting offline snapshot 75359aaf-9817-4313-a206-cbce863978f9 of volume 5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] snapshot_file for this snap is: volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b105f-e4b2-488c-934a-9b3abc56d901]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:21 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Deleted volume successfully. Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-53a22444-272d-4dba-9e02-4a718a580cf3 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-3d71721a-7595-4f5d-9678-854a3373124b-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:21 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:21 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:21 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 1073741824" returned: 0 in 0.891s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:22 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 Jul 09 01:22:22 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:22 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b27c6fe-da18-4778-ab65-fd683f74b506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c3950-e9ba-456a-9f6b-22ead54979b9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:22 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:22 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (aea5f000-0767-45ba-843b-b988929e078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700f2aa2-f2cd-4554-b917-422dda79d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700f2aa2-f2cd-4554-b917-422dda79d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1117177343',display_name='tempest-VolumesGetTest-Volume-1786078024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:22Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d1f54-94dd-4813-ab14-08924e86ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d1f54-94dd-4813-ab14-08924e86ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8528c7-0a7d-4110-90df-29de66844473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8528c7-0a7d-4110-90df-29de66844473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca', 'volume_name': 'volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4d8f3-7524-4914-ba25-fe8c609a9c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4d8f3-7524-4914-ba25-fe8c609a9c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410935ac-3c1c-4412-b964-77480d4187b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Volume 7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca', 'volume_size': 1} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:22 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" returned: 0 in 0.694s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1117177343',display_name='tempest-VolumesGetTest-Volume-1786078024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:22Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Creating volume 7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:22 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:22 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca 1073741824 Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a52cba-b000-4bcb-a13c-7e18ffbb24d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b01ce7-9f99-4136-ab98-1206d44680de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Volume volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 (3bfdf39f-707c-42c0-beca-b0733ca3b1b8): created successfully Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b01ce7-9f99-4136-ab98-1206d44680de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Flow 'volume_create_manager' (918dfcd9-c240-4abc-b8de-1a925c5a3dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f62ae3a1-590c-4f55-9508-37121208c4a9 tempest-VolumesListTestJSON-2071439330 None] Created volume successfully. Jul 09 01:22:22 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.786s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:22 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:22 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:23 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca 1073741824" returned: 0 in 0.813s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:23 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca Jul 09 01:22:23 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:23 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.762s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:23 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9 Jul 09 01:22:23 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:24 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410935ac-3c1c-4412-b964-77480d4187b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27a67ec-1409-4364-9037-863aef174f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Volume volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca (7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca): created successfully Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27a67ec-1409-4364-9037-863aef174f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (aea5f000-0767-45ba-843b-b988929e078b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c217190d-5ecf-417e-9694-8cbdb33c1a2c tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:22:24 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506.75359aaf-9817-4313-a206-cbce863978f9" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-75359aaf-9817-4313-a206-cbce863978f9" released by "_delete_snapshot" :: held 3.185s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" released by "delete_snapshot" :: held 3.215s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['0857fbe5-5d97-4322-ba43-0183f4b449c7', '241cd132-79ea-4802-ae9e-3e075a3750e1', 'f7517ce7-67fc-4be9-bf4b-c65269045594', 'a807b191-4ef0-4305-a463-a8f674a170cb'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Delete snapshot completed successfully. Jul 09 01:22:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-171857b8-6f17-40b4-a353-5251f6a0a0b1 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-75359aaf-9817-4313-a206-cbce863978f9-delete_snapshot" released by "delete_snapshot" :: held 3.362s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-5b27c6fe-da18-4778-ab65-fd683f74b506-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-5b27c6fe-da18-4778-ab65-fd683f74b506-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac224df5-98d2-4ad2-ac15-87ad314eff92]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "cinder-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" acquired by "delete_volume" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:25 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:25 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebc631-78da-47ff-aa72-c02917523559]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:25 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca Jul 09 01:22:25 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-3bfdf39f-707c-42c0-beca-b0733ca3b1b8-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-3bfdf39f-707c-42c0-beca-b0733ca3b1b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-quobyte-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c874a3-df92-4aa5-a112-d43e512caa56]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:26 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 Jul 09 01:22:26 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:26 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.832s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:26 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506 Jul 09 01:22:26 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:26 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:26 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca Jul 09 01:22:26 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:27 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:27 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8 Jul 09 01:22:27 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:27 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5b27c6fe-da18-4778-ab65-fd683f74b506" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-5b27c6fe-da18-4778-ab65-fd683f74b506" released by "delete_volume" :: held 1.599s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['3c0f379d-033d-4316-a2c8-59d92177d7d2', '16ad6865-92f9-414c-91cd-10c87c0d351f', '5ad68e78-01aa-439d-9eae-dd60d3f870d3', 'e5bed5fb-f112-4686-bb04-8327d03719ff'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:27 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" returned: 0 in 0.691s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:27 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:27 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca" released by "delete_volume" :: held 1.602s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Created reservations ['3fb16b9b-5f14-479c-9eef-66a3247f0505', '5d593ade-0bb9-474f-8fa3-36dc005df309', '7b69b061-73b2-4081-80b0-7161dc0c1ebb', '67798bbd-dad5-4096-8c40-d3bbed0b5ca8'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:27 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:27 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:27 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-3bfdf39f-707c-42c0-beca-b0733ca3b1b8" released by "delete_volume" :: held 1.556s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Created reservations ['60a32640-92e2-4cf8-bf07-7dd0de9817cb', '954a2e80-532c-41c9-8267-76ef0c7ecbdc', 'cd68d85c-1ee1-41f5-bc67-139b37ee191c', 'fbc080a3-7f02-4889-8fc9-0c7d2159e4df'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "cinder-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:28 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.805s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Deleted volume successfully. Jul 09 01:22:28 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:28 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" acquired by "delete_volume" :: waited 0.042s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1a296657-328d-45b0-8fdc-d41a984795ae tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-5b27c6fe-da18-4778-ab65-fd683f74b506-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951351c-ced5-4f0c-9454-82bb8bbd6b50]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:28 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.757s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7af8430a-f4d7-4ac6-8b02-9b6c8645d637 tempest-VolumesGetTest-1915079884 None] Lock "cinder-7cd6ce5c-bae4-4ceb-bd5c-d4ba8dd6f4ca-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:28 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f Jul 09 01:22:28 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (5b0fcef6-b1a9-46ea-957c-ed413d279a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8442422-6d9d-4cd9-ad31-66ff7dee1171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8442422-6d9d-4cd9-ad31-66ff7dee1171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072117912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4198ae1-a297-4ee9-8b2c-ba4e28481f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:28Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f466cf-a046-4aed-8524-c9dc834fb7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f466cf-a046-4aed-8524-c9dc834fb7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2ad059-9809-4526-9198-bccf6bde94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2ad059-9809-4526-9198-bccf6bde94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4198ae1-a297-4ee9-8b2c-ba4e28481f1a', 'volume_name': 'volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec706d3-589c-48dd-971d-98addd144ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec706d3-589c-48dd-971d-98addd144ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5420bfd-080f-44f7-826f-2ed683eeb176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:28 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Volume d4198ae1-a297-4ee9-8b2c-ba4e28481f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a', 'volume_size': 1} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072117912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4198ae1-a297-4ee9-8b2c-ba4e28481f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:28Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Creating volume d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:28 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-c7544ea4-8381-4c31-ae40-9ab223b286df-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:28 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a 1073741824 Jul 09 01:22:28 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-c7544ea4-8381-4c31-ae40-9ab223b286df-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-quobyte-c7544ea4-8381-4c31-ae40-9ab223b286df" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-c7544ea4-8381-4c31-ae40-9ab223b286df" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[101c5b1f-b136-4c0c-ba0a-abb660bd2b5f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:29 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.974s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:29 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df Jul 09 01:22:29 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Deleted volume successfully. Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fce8d346-a43b-4843-b396-c4c0c21576e4 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-3bfdf39f-707c-42c0-beca-b0733ca3b1b8-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:29 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" returned: 0 in 1.074s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:29 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f Jul 09 01:22:29 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:29 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a 1073741824" returned: 0 in 1.025s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:29 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:22:29 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:29 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df" returned: 0 in 0.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:29 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df Jul 09 01:22:29 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:29 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f" released by "delete_volume" :: held 1.820s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Created reservations ['92150e28-b8cd-4fc5-a7b3-512146f87b11', 'd0848505-4044-41c6-8834-ee3a087350e4', '1453fe1a-89e9-4f95-b658-e7b556f48882', 'd0918055-9f9d-4786-9e1a-fd3d512ee25e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:30 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:30 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:30 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5420bfd-080f-44f7-826f-2ed683eeb176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765c7a1-da69-4b8e-a77c-549e7c0080f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Volume volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a (d4198ae1-a297-4ee9-8b2c-ba4e28481f1a): created successfully Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765c7a1-da69-4b8e-a77c-549e7c0080f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (5b0fcef6-b1a9-46ea-957c-ed413d279a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-41ea1021-3803-4827-ba3e-b7ef5f79543a tempest-VolumesSnapshotTestJSON-722866701 None] Created volume successfully. Jul 09 01:22:30 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c7544ea4-8381-4c31-ae40-9ab223b286df" returned: 0 in 0.736s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-c7544ea4-8381-4c31-ae40-9ab223b286df" released by "delete_volume" :: held 1.753s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Created reservations ['d2c430cb-731f-41c1-840c-d037bbd6dd74', 'a9ca44fa-a5f1-4fe9-824b-4b66f9ae9cc8', '9de14d67-1e46-441f-82ec-b314f6fde1cd', 'c4b186e8-c703-4f04-a925-09f0206d0aee'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:30 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:30 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (92e29353-1729-4018-8354-35ac08b9009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5770bc4-fcda-434f-8cd1-2dda0f62a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.850s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5770bc4-fcda-434f-8cd1-2dda0f62a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361334111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1d7053-3cf5-4c93-bbbc-454860435b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:31Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97dfddf-f167-4e5a-8f6f-479ffdebc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97dfddf-f167-4e5a-8f6f-479ffdebc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc483ed-a78a-408c-b329-04134f6260f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc483ed-a78a-408c-b329-04134f6260f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1d7053-3cf5-4c93-bbbc-454860435b80', 'volume_name': 'volume-9c1d7053-3cf5-4c93-bbbc-454860435b80', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4ad20c-038d-46b2-b78b-0314e0b09cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4ad20c-038d-46b2-b78b-0314e0b09cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9222c90-3b1e-4d2a-b165-fd903d6a6a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Volume 9c1d7053-3cf5-4c93-bbbc-454860435b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1d7053-3cf5-4c93-bbbc-454860435b80', 'volume_size': 1} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361334111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1d7053-3cf5-4c93-bbbc-454860435b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:31Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Creating volume 9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:30 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:31 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 1073741824 Jul 09 01:22:31 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f41eea24-9b1f-4b45-92ba-84fe5f2f3b83 tempest-VolumesGetTest-1915079884 None] Lock "cinder-61e8e652-d93c-4e1f-af0b-af3f0cee3e3f-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-70a98fb5-9b30-453e-87e2-d7894e82ecc3-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-70a98fb5-9b30-453e-87e2-d7894e82ecc3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "cinder-quobyte-70a98fb5-9b30-453e-87e2-d7894e82ecc3" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-70a98fb5-9b30-453e-87e2-d7894e82ecc3" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4233bf3d-c2ff-4c83-be28-7c28a6aae129]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:31 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 Jul 09 01:22:31 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:31 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Deleted volume successfully. Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ff98e29b-d3c7-4253-98ee-5bdb5db1296b tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-c7544ea4-8381-4c31-ae40-9ab223b286df-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:31 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 1073741824" returned: 0 in 0.935s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:31 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3" returned: 0 in 0.798s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:31 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:22:31 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:32 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3 Jul 09 01:22:32 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:32 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.672s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.620s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:32 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9222c90-3b1e-4d2a-b165-fd903d6a6a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1d7053-3cf5-4c93-bbbc-454860435b80', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d783d2-59e2-46a6-9e27-48b392e7c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Creating offline snapshot 0a4b6d99-2a55-4936-aea6-d79946dd60c3 of volume d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-70a98fb5-9b30-453e-87e2-d7894e82ecc3" returned: 0 in 0.696s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f313f81-a3bd-4df5-be4c-d7754ebdd17b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-quobyte-70a98fb5-9b30-453e-87e2-d7894e82ecc3" released by "delete_volume" :: held 1.551s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:32 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Volume volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 (9c1d7053-3cf5-4c93-bbbc-454860435b80): created successfully Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d783d2-59e2-46a6-9e27-48b392e7c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (92e29353-1729-4018-8354-35ac08b9009c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-16fc60fb-f65c-4582-ad4f-dc3c19efca12 tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Created reservations ['0fee14fe-46be-40c6-84f6-f710d93a9b62', '85bec516-a00b-46f4-a74c-f30376c256c7', '54c1ac87-bd8d-4169-8cdf-545a6630d6ff', '3ea385ea-7ba6-451a-9c42-9054bbdae15e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:22:32 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:22:32 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:32 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:32 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (e5e07991-d2b8-4d56-a3ae-d624777473e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23769c6-217d-4e2b-91ef-b71bb02420b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23769c6-217d-4e2b-91ef-b71bb02420b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1049320383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e9e54-371a-404c-a620-dabc6ff27767,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9c1d7053-3cf5-4c93-bbbc-454860435b80,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:33Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d4dc8f-044b-4304-a3c4-fee68d94680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:33 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d4dc8f-044b-4304-a3c4-fee68d94680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bbbc9-78f2-4b06-806f-026cdd9b7e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 0.882s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bbbc9-78f2-4b06-806f-026cdd9b7e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '330e9e54-371a-404c-a620-dabc6ff27767', 'volume_name': 'volume-330e9e54-371a-404c-a620-dabc6ff27767', 'volume_size': 1, 'source_volid': '9c1d7053-3cf5-4c93-bbbc-454860435b80', 'source_volstatus': 'available'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:33 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 1G Jul 09 01:22:33 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08019f15-862d-4ec6-97d2-aca25d0aa18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08019f15-862d-4ec6-97d2-aca25d0aa18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df34e2cc-3647-4b6b-90a0-9ccf53f1b136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Volume 330e9e54-371a-404c-a620-dabc6ff27767: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-330e9e54-371a-404c-a620-dabc6ff27767', 'volume_size': 1, 'source_volid': '9c1d7053-3cf5-4c93-bbbc-454860435b80', 'source_volstatus': 'available'} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:33 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.801s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Deleted volume successfully. Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-529387f8-0e19-4310-8f63-a6f16f7c97f6 tempest-VolumesListTestJSON-2071439330 None] Lock "cinder-70a98fb5-9b30-453e-87e2-d7894e82ecc3-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:33 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:22:33 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:34 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 1G" returned: 0 in 0.913s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:34 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:22:34 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:34 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.724s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:22:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:22:35 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 0.792s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:35 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 is being set with open permissions: ugo+rw Jul 09 01:22:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:35 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:22:35 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:35 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 0.672s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:35 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=152,cinder:DELETE=15,cinder:SELECT=98,cinder:INSERT=37 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:22:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:36 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info Jul 09 01:22:36 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Flow 'volume_create_manager' (7fbedb0a-bdea-4361-866d-50fe74101cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63033fe2-620c-4569-9e2a-bc7bc4dbe292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63033fe2-620c-4569-9e2a-bc7bc4dbe292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1153738257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c2db7f-27db-451b-8f05-f8357d809f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0641c8dcbc8743f0ba26d06a04b29da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:36Z,use_quota=True,user_id='533288989f164b36850cb399052c5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace11d8c-db93-4225-a74e-5ece91a26d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace11d8c-db93-4225-a74e-5ece91a26d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec131f6-f0f3-4a13-a511-199cbc3df83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec131f6-f0f3-4a13-a511-199cbc3df83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c2db7f-27db-451b-8f05-f8357d809f71', 'volume_name': 'volume-43c2db7f-27db-451b-8f05-f8357d809f71', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c9ef2-148c-41a1-9a5d-e41159b7b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c9ef2-148c-41a1-9a5d-e41159b7b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7167be55-dd3a-43f0-8a9b-ba4c87e97f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Volume 43c2db7f-27db-451b-8f05-f8357d809f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c2db7f-27db-451b-8f05-f8357d809f71', 'volume_size': 1} Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:36 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info" returned: 0 in 0.712s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:36 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info is being set with open permissions: ugo+rw Jul 09 01:22:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:36 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info Jul 09 01:22:36 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:37 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.info" returned: 0 in 0.664s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.756s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:37 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Cloning volume 9c1d7053-3cf5-4c93-bbbc-454860435b80 to volume 330e9e54-371a-404c-a620-dabc6ff27767 Jul 09 01:22:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6402201c-abe5-45c6-ad5a-8997ca484cc8 tempest-VolumesSnapshotTestJSON-722866701 None] Create snapshot completed successfully Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Creating offline snapshot 00de0651-a176-4ccd-9a4a-3fb35f8f102b of volume 9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f0fe1f-1e0b-4f3f-8e57-05ff041f8e4f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:37 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:22:37 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:38 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:38 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b 1G Jul 09 01:22:38 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (f9815c1f-a222-4e40-bfb8-f612a4b37e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9751b99f-8e05-4ada-92b4-1f8eb6121aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9751b99f-8e05-4ada-92b4-1f8eb6121aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1534455005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89273b69-a652-456b-ad69-9ca30ca5d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4924125209942d199fc61847a30c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a4b6d99-2a55-4936-aea6-d79946dd60c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:39Z,use_quota=True,user_id='ce55e10a10ea41f0adae65d129bc39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e92f2b3-6509-438b-9d17-aa9cdc3493af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e92f2b3-6509-438b-9d17-aa9cdc3493af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50626e6d-4f0c-4ea3-b718-e3305f485789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50626e6d-4f0c-4ea3-b718-e3305f485789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89273b69-a652-456b-ad69-9ca30ca5d585', 'volume_name': 'volume-89273b69-a652-456b-ad69-9ca30ca5d585', 'volume_size': 1, 'snapshot_id': '0a4b6d99-2a55-4936-aea6-d79946dd60c3'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b41373-7c5b-4b5d-9b68-956bb2645037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b41373-7c5b-4b5d-9b68-956bb2645037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18a5d3-65dd-4b8b-bcfa-9e5c9b6de35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Volume 89273b69-a652-456b-ad69-9ca30ca5d585: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89273b69-a652-456b-ad69-9ca30ca5d585', 'volume_size': 1, 'snapshot_id': '0a4b6d99-2a55-4936-aea6-d79946dd60c3'} Jul 09 01:22:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:39 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b 1G" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:39 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:39 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:39 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.723s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:39 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b is being set with open permissions: ugo+rw Jul 09 01:22:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:39 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:39 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:40 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.637s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:40 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info Jul 09 01:22:40 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:41 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:41 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info is being set with open permissions: ugo+rw Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:41 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info Jul 09 01:22:41 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:41 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.info" returned: 0 in 0.641s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] snapshot: 00de0651-a176-4ccd-9a4a-3fb35f8f102b, volume: 330e9e54-371a-404c-a620-dabc6ff27767, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274a021-0824-4141-8e08-a33ae20133d3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:41 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:41 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:42 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.765s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c1d7053-3cf5-4c93-bbbc-454860435b80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d594a730-6d3b-4bc0-a4a4-72ac4603bc09]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:42 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:22:42 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:43 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.760s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:43 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:22:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:43 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 Jul 09 01:22:43 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:47 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767" returned: 0 in 4.588s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce7bb1f-05c7-4ba8-8402-8a8a0ef12867]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:48 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:22:48 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:48 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:48 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:22:48 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Converted 1024.00 MB image at 223.14 MB/s Jul 09 01:22:48 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 is being set with open permissions: ugo+rw Jul 09 01:22:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:48 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 Jul 09 01:22:48 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:49 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767" returned: 0 in 0.639s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" released by "_copy_volume_from_snapshot" :: held 7.750s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-00de0651-a176-4ccd-9a4a-3fb35f8f102b" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-00de0651-a176-4ccd-9a4a-3fb35f8f102b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Deleting offline snapshot 00de0651-a176-4ccd-9a4a-3fb35f8f102b of volume 9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] snapshot_file for this snap is: volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b9a93-c08f-45d3-afc3-21cb24698093]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:49 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:49 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:50 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.753s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c1d7053-3cf5-4c93-bbbc-454860435b80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf998a4f-6d6a-4ada-81e8-0ce60e009b48]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:50 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:22:50 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:22:50 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:51 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:51 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:51 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:51 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.722s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:51 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b Jul 09 01:22:51 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:52 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80.00de0651-a176-4ccd-9a4a-3fb35f8f102b" returned: 0 in 0.636s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-00de0651-a176-4ccd-9a4a-3fb35f8f102b" released by "_delete_snapshot" :: held 2.956s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.191s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.084s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1153738257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c2db7f-27db-451b-8f05-f8357d809f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0641c8dcbc8743f0ba26d06a04b29da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:36Z,use_quota=True,user_id='533288989f164b36850cb399052c5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Creating volume 43c2db7f-27db-451b-8f05-f8357d809f71 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:52 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df34e2cc-3647-4b6b-90a0-9ccf53f1b136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330e9e54-371a-404c-a620-dabc6ff27767', 'volume_size': 1, 'source_volid': '9c1d7053-3cf5-4c93-bbbc-454860435b80', 'source_volstatus': 'available'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:52 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 1073741824 Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08779e35-90c8-45d7-bfcd-c1881c88eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:52 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Volume volume-330e9e54-371a-404c-a620-dabc6ff27767 (330e9e54-371a-404c-a620-dabc6ff27767): created successfully Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08779e35-90c8-45d7-bfcd-c1881c88eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (e5e07991-d2b8-4d56-a3ae-d624777473e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-478f4778-ac65-4fb5-890b-6e40df199784 tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (938098c3-1592-4d85-81b5-5e8c625cd545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2d7ccd-f6e0-4d25-bb4b-6e08b642630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:53 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2d7ccd-f6e0-4d25-bb4b-6e08b642630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394649718',display_name='tempest-VolumesGetTest-Volume-467608150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b32b8-825c-40e7-b8f3-c3f8e06b7320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:53Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4704a698-fd04-4856-adc3-1e9aca40f807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4704a698-fd04-4856-adc3-1e9aca40f807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cf94f4-1151-434a-a08c-21756bc82fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cf94f4-1151-434a-a08c-21756bc82fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2b32b8-825c-40e7-b8f3-c3f8e06b7320', 'volume_name': 'volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5712bb-0524-4dd6-ac35-79236687ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5712bb-0524-4dd6-ac35-79236687ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95548457-bcc3-4ac7-87fd-296870a01e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:53 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Volume dc2b32b8-825c-40e7-b8f3-c3f8e06b7320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320', 'volume_size': 1} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 1073741824" returned: 0 in 0.932s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:53 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 Jul 09 01:22:53 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:54 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.410s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3-89273b69-a652-456b-ad69-9ca30ca5d585" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7167be55-dd3a-43f0-8a9b-ba4c87e97f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c2db7f-27db-451b-8f05-f8357d809f71', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53731eb-7a69-46af-8a4c-035c36a9284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3-89273b69-a652-456b-ad69-9ca30ca5d585" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Creating volume 89273b69-a652-456b-ad69-9ca30ca5d585 from snapshot 0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:22:54 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Volume volume-43c2db7f-27db-451b-8f05-f8357d809f71 (43c2db7f-27db-451b-8f05-f8357d809f71): created successfully Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53731eb-7a69-46af-8a4c-035c36a9284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Flow 'volume_create_manager' (7fbedb0a-bdea-4361-866d-50fe74101cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] snapshot: 0a4b6d99-2a55-4936-aea6-d79946dd60c3, volume: 89273b69-a652-456b-ad69-9ca30ca5d585, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:22:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-886c654d-32f8-45c2-8c72-59b695216513 tempest-VolumesNegativeTest-429716039 None] Created volume successfully. Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036742e-ede6-409f-89a9-f1bc40c38816]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:54 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:22:54 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:55 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 0.760s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb21cb-ef00-4d56-a73b-3496f78b9be2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:55 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:22:55 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:22:55 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 0.816s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:22:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:22:55 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 Jul 09 01:22:55 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:00 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585" returned: 0 in 4.835s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ee1ea9-27fa-415e-bbf8-6a797b180c99]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:00 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:23:00 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:01 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 1.119s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:01 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:23:01 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Converted 1024.00 MB image at 211.74 MB/s Jul 09 01:23:01 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 is being set with open permissions: ugo+rw Jul 09 01:23:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:01 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 Jul 09 01:23:01 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:02 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" released by "_copy_volume_from_snapshot" :: held 8.351s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3-89273b69-a652-456b-ad69-9ca30ca5d585" released by "_create_volume_from_snapshot" :: held 8.396s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.429s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.128s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:22:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394649718',display_name='tempest-VolumesGetTest-Volume-467608150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b32b8-825c-40e7-b8f3-c3f8e06b7320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:22:53Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Creating volume dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:23:02 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:02 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 1073741824 Jul 09 01:23:02 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=94,cinder:UPDATE=121,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18a5d3-65dd-4b8b-bcfa-9e5c9b6de35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89273b69-a652-456b-ad69-9ca30ca5d585', 'volume_size': 1, 'snapshot_id': '0a4b6d99-2a55-4936-aea6-d79946dd60c3'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9fb267-5c84-41ca-9874-5d969143079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:02 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Volume volume-89273b69-a652-456b-ad69-9ca30ca5d585 (89273b69-a652-456b-ad69-9ca30ca5d585): created successfully Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9fb267-5c84-41ca-9874-5d969143079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:02 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Flow 'volume_create_manager' (f9815c1f-a222-4e40-bfb8-f612a4b37e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c5bc0a98-8890-4671-9813-747c6a230a3f tempest-VolumesSnapshotTestJSON-722866701 None] Created volume successfully. Jul 09 01:23:03 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 1073741824" returned: 0 in 0.933s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:03 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 Jul 09 01:23:03 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-89273b69-a652-456b-ad69-9ca30ca5d585-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-89273b69-a652-456b-ad69-9ca30ca5d585-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56081f06-ffa8-48d3-b878-8370bd584803]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:04 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 Jul 09 01:23:04 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:04 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" returned: 0 in 0.720s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95548457-bcc3-4ac7-87fd-296870a01e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ac767c-530e-45a7-a5e1-fc33e65f3f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Volume volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 (dc2b32b8-825c-40e7-b8f3-c3f8e06b7320): created successfully Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ac767c-530e-45a7-a5e1-fc33e65f3f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (938098c3-1592-4d85-81b5-5e8c625cd545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-58ce6213-86b9-4e07-969c-a4dab3e9cddc tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:23:04 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585" returned: 0 in 0.778s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:04 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585 Jul 09 01:23:04 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:05 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-89273b69-a652-456b-ad69-9ca30ca5d585" returned: 0 in 0.665s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-89273b69-a652-456b-ad69-9ca30ca5d585" released by "delete_volume" :: held 1.496s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "cinder-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['89d0159b-6710-457b-a963-ba19c014b9ae', '70c51499-bd4c-405b-920e-1ba8726c0872', '5248f81e-c32c-47b5-9e77-24cd9959c1d7', '1a359a25-1a6d-4810-ad4a-7996dd8045f3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b6e18-c990-4e9f-a48a-62ca28739e86]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:05 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:05 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:05 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 Jul 09 01:23:05 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-0a4b6d99-2a55-4936-aea6-d79946dd60c3-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-0a4b6d99-2a55-4936-aea6-d79946dd60c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Deleting offline snapshot 0a4b6d99-2a55-4936-aea6-d79946dd60c3 of volume d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] snapshot_file for this snap is: volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e244f37-9141-4f4b-a97e-6c6dfcea76e5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:06 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:23:06 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:06 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" returned: 0 in 1.219s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:06 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.232s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:06 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Deleted volume successfully. Jul 09 01:23:06 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320 Jul 09 01:23:06 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-842bae3d-cdf9-47fa-914c-c4406e204d8a tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-89273b69-a652-456b-ad69-9ca30ca5d585-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:07 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 1.083s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d758a4a-2815-4bbc-b870-6c75bb070daf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:07 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" returned: 0 in 0.863s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:07 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:23:07 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320" released by "delete_volume" :: held 2.141s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Created reservations ['1cf9dfec-cf02-4a83-86e6-c44bc40fcb21', 'f35c1038-d4c1-43f3-a444-f56221ff6e2d', '1f2250d4-1807-49da-9872-7933d3867372', '6d6603df-7cf1-4738-8da0-9ad75d585bdc'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:08 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:08 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:08 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 0.916s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:08 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:23:08 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:08 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.769s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:08 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:23:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6677f0c6-3635-4c92-8612-a65ab58cbaf7 tempest-VolumesGetTest-1915079884 None] Lock "cinder-dc2b32b8-825c-40e7-b8f3-c3f8e06b7320-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-330e9e54-371a-404c-a620-dabc6ff27767-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "cinder-330e9e54-371a-404c-a620-dabc6ff27767-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6745f6b7-5b33-4684-9c08-911a5423b505]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:09 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 Jul 09 01:23:09 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:09 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 0.945s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:09 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3 Jul 09 01:23:09 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:10 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767" returned: 0 in 0.969s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:10 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767 Jul 09 01:23:10 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:10 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a.0a4b6d99-2a55-4936-aea6-d79946dd60c3" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-0a4b6d99-2a55-4936-aea6-d79946dd60c3" released by "_delete_snapshot" :: held 3.894s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" released by "delete_snapshot" :: held 3.930s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['8927286c-d599-4714-a2d4-da36306ed768', 'ce5c0f24-8ee5-408a-b582-f0852dbf0088', 'f30c194f-0d9a-4575-b754-946983db7fd7', 'a7b3e3bc-5220-431a-956c-bfbe551ad4ed'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Delete snapshot completed successfully. Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9614cc4d-2be9-485a-8682-278266bdea55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-0a4b6d99-2a55-4936-aea6-d79946dd60c3-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:11 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154f44e-914e-4829-af7e-b6eabc10bc6c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-330e9e54-371a-404c-a620-dabc6ff27767" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-330e9e54-371a-404c-a620-dabc6ff27767" released by "delete_volume" :: held 1.950s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Created reservations ['e95bf3da-be7d-4c15-a127-dc020fd88246', '02d4a78b-a3fc-46fb-ae29-6ce8f287ef99', 'dab92c96-3c4c-4b75-842b-7a1a382e18fa', '1fc8dd30-302a-4f22-81bb-96dc18ecc801'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:11 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:23:11 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:11 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:11 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-9c1d7053-3cf5-4c93-bbbc-454860435b80-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "cinder-9c1d7053-3cf5-4c93-bbbc-454860435b80-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-9c1d7053-3cf5-4c93-bbbc-454860435b80" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-9c1d7053-3cf5-4c93-bbbc-454860435b80" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1330bde-6410-4d67-bbb0-4a085e19ea00]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:11 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:23:11 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:12 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 1.057s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:12 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a Jul 09 01:23:12 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:12 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.916s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:12 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b7b8130d-4c48-4592-acf1-66ba6a0dd2cf tempest-VolumesGetTest-1915079884 None] Lock "cinder-330e9e54-371a-404c-a620-dabc6ff27767-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:12 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.859s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:12 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80 Jul 09 01:23:12 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:12 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a" released by "delete_volume" :: held 1.893s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['e1f2e107-e3fb-4604-af06-64fe75ec375e', 'cb03e3b0-fb2d-4f57-9689-308912486b8f', '37f9854d-2466-4e5b-9302-20e2ab50ea50', '26c0c659-845b-43a1-a357-26fcc4b78916'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:13 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:13 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-1801bdfd-56b2-4f68-ba94-ba853182e85c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-1801bdfd-56b2-4f68-ba94-ba853182e85c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:13 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9c1d7053-3cf5-4c93-bbbc-454860435b80" returned: 0 in 0.944s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" acquired by "delete_volume" :: waited 0.046s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-9c1d7053-3cf5-4c93-bbbc-454860435b80" released by "delete_volume" :: held 1.945s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a73f44-1fff-4a3b-9b90-6acc0c78d3c1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Created reservations ['e4bc4dcc-4087-45ef-9e2f-d5c8aff69a77', 'd9f25b9f-4436-4546-9327-c457b1d49230', 'd411a6b0-2240-4618-9bea-c169796570d9', 'dd0e8e89-6129-41f4-a76b-b36db1bab25d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:13 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c Jul 09 01:23:13 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:13 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:13 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:13 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:13 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Deleted volume successfully. Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7eb5f275-112b-40be-b4de-d1463288decc tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-d4198ae1-a297-4ee9-8b2c-ba4e28481f1a-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:14 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c" returned: 0 in 1.136s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:14 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c Jul 09 01:23:14 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:14 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.081s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:23:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1ce69221-b12d-4938-846e-00fede338ed4 tempest-VolumesGetTest-1915079884 None] Lock "cinder-9c1d7053-3cf5-4c93-bbbc-454860435b80-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (e4873e9b-839f-4b46-87b9-11ee57252de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d363f0-7423-4272-a0c5-ae0083fdda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d363f0-7423-4272-a0c5-ae0083fdda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-415737422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23761e0d-a758-4177-95c7-9dd9393e062c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:15Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7ce93-9a63-4144-84e2-bbb85f73f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7ce93-9a63-4144-84e2-bbb85f73f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d531f245-0b6e-4623-9bdd-1dd77182eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:23:15 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1801bdfd-56b2-4f68-ba94-ba853182e85c" returned: 0 in 0.695s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-quobyte-1801bdfd-56b2-4f68-ba94-ba853182e85c" released by "delete_volume" :: held 1.905s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d531f245-0b6e-4623-9bdd-1dd77182eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23761e0d-a758-4177-95c7-9dd9393e062c', 'volume_name': 'volume-23761e0d-a758-4177-95c7-9dd9393e062c', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d134f158-cd90-455b-a382-4e1be4f2b49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d134f158-cd90-455b-a382-4e1be4f2b49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5cf66-4c1e-416c-abc6-e75a2e74600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:15 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Volume 23761e0d-a758-4177-95c7-9dd9393e062c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23761e0d-a758-4177-95c7-9dd9393e062c', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Trying to clone 23761e0d-a758-4177-95c7-9dd9393e062c from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Created reservations ['9a4b86b6-df46-480c-910b-a262ce81e69c', '474007fa-24ea-4e37-8eee-cf0a99b832df', '984806e6-6d66-4e3d-bc27-d3990806a67e', 'c4933294-4a9b-4e6e-8fd4-e3a0f87156ab'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:15 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:15 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:23:15 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Image download 20.69 MB at 20.69 MB/s Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d8f0be-f63b-45de-8cda-0de2a2240da1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:16 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD Jul 09 01:23:16 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:16 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.764s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Deleted volume successfully. Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-296b06de-eaae-4ae9-abc9-ad3d75b6fb55 tempest-VolumesSnapshotTestJSON-722866701 None] Lock "cinder-1801bdfd-56b2-4f68-ba94-ba853182e85c-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:16 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 is fetched for user e75cfcd82219414f875dada2390ca337. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5cddda-00bf-49b1-9e10-a59433c67bc5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:17 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD Jul 09 01:23:17 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:17 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-415737422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23761e0d-a758-4177-95c7-9dd9393e062c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:15Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Creating volume 23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:23:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:23:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:17 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1073741824 Jul 09 01:23:17 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:18 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1073741824" returned: 0 in 0.889s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:18 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:18 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:19 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 0 in 0.750s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Attempting download of 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 23761e0d-a758-4177-95c7-9dd9393e062c. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af8744-8758-49d0-9f97-c0ad16cb8075]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:19 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py Jul 09 01:23:19 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:20 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py" returned: 0 in 0.772s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:20 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py Jul 09 01:23:20 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:21 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py" returned: 1 in 0.858s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_xe3a63py' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4e932-1deb-4a45-8d7f-fd7ab74e5779]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:21 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD Jul 09 01:23:21 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:21 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] 52f835e6-23a6-4938-9b95-f63e8048dcd3 was qcow2, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:23:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:21 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:21 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Flow 'volume_create_manager' (6bc9db8c-8ad1-4110-949f-4c1425f4e1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0303a4bc-333c-4dc7-a701-a47e1425ca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0303a4bc-333c-4dc7-a701-a47e1425ca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1991374851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729d8052-ac40-4b5d-b5a1-d167ce02bb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22099d882b874b01a86d88becb387327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:22Z,use_quota=True,user_id='82629be731714e9db1e2c3bb0dc97245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f2919c-fdb8-4a47-8811-4b049095e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f2919c-fdb8-4a47-8811-4b049095e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfad5f2f-4376-42ed-9fc6-5da1b4050ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfad5f2f-4376-42ed-9fc6-5da1b4050ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729d8052-ac40-4b5d-b5a1-d167ce02bb47', 'volume_name': 'volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46b218-f733-4b46-b957-991879a76d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46b218-f733-4b46-b957-991879a76d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92270ea2-b80b-49e9-b2ab-44c22a6bfa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47', 'volume_size': 1} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1991374851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729d8052-ac40-4b5d-b5a1-d167ce02bb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22099d882b874b01a86d88becb387327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:22Z,use_quota=True,user_id='82629be731714e9db1e2c3bb0dc97245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Creating volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:23:22 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:23:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:22 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 1073741824 Jul 09 01:23:22 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:23 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 1073741824" returned: 0 in 1.107s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:23 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 Jul 09 01:23:23 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:24 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 0 in 2.189s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_n4sg1qlzdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:23:24 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Converted 112.00 MB image at 51.13 MB/s Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:24 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1G Jul 09 01:23:24 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:24 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47" returned: 0 in 0.720s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92270ea2-b80b-49e9-b2ab-44c22a6bfa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9f3a7e-dab3-40d1-a131-439d9debcc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Volume volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 (729d8052-ac40-4b5d-b5a1-d167ce02bb47): created successfully Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9f3a7e-dab3-40d1-a131-439d9debcc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Flow 'volume_create_manager' (6bc9db8c-8ad1-4110-949f-4c1425f4e1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bc9071f2-dd19-492d-9ebd-209fb4970a8f tempest-VolumesSnapshotListTestJSON-1193327402 None] Created volume successfully. Jul 09 01:23:24 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c 1G" returned: 0 in 0.763s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a716082-8c40-4c16-b9ed-5d1d78a64884]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:25 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:25 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:25 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 0 in 0.822s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Creating offline snapshot c2146e7f-7fdf-483b-ae84-8728b6ae724a of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6a1d55-e62c-4265-82da-291b77cf1bc7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:25 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:25 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:26 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 Jul 09 01:23:26 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Acquiring lock "cinder-43c2db7f-27db-451b-8f05-f8357d809f71-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "cinder-43c2db7f-27db-451b-8f05-f8357d809f71-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Acquiring lock "cinder-quobyte-43c2db7f-27db-451b-8f05-f8357d809f71" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "cinder-quobyte-43c2db7f-27db-451b-8f05-f8357d809f71" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdcaf1-170c-4405-bb28-3434b2de7f53]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:26 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 Jul 09 01:23:26 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:26 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 1 in 0.871s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Downloaded image 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 23761e0d-a758-4177-95c7-9dd9393e062c successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 for user e75cfcd82219414f875dada2390ca337 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Marking volume 23761e0d-a758-4177-95c7-9dd9393e062c as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Copying metadata from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 to 23761e0d-a758-4177-95c7-9dd9393e062c. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Creating volume glance metadata for volume 23761e0d-a758-4177-95c7-9dd9393e062c backed by image 52f835e6-23a6-4938-9b95-f63e8048dcd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:23:26 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:26 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a 1G Jul 09 01:23:26 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5cf66-4c1e-416c-abc6-e75a2e74600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23761e0d-a758-4177-95c7-9dd9393e062c', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560963a-3712-4c52-a108-47bd54ca9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Volume volume-23761e0d-a758-4177-95c7-9dd9393e062c (23761e0d-a758-4177-95c7-9dd9393e062c): created successfully Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560963a-3712-4c52-a108-47bd54ca9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (e4873e9b-839f-4b46-87b9-11ee57252de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fb18dbad-e656-48ff-8790-f04fa44698ee tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:23:27 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71" returned: 0 in 0.846s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:27 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71 Jul 09 01:23:27 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:27 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a 1G" returned: 0 in 0.907s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:27 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:27 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:27 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-43c2db7f-27db-451b-8f05-f8357d809f71" returned: 0 in 0.717s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "cinder-quobyte-43c2db7f-27db-451b-8f05-f8357d809f71" released by "delete_volume" :: held 1.633s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (ea324717-31c7-41e3-8056-f8777b29071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59c84a-ab7f-4b0d-9a50-aafb587a5631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59c84a-ab7f-4b0d-9a50-aafb587a5631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119938929',display_name='tempest-VolumesGetTest-Volume-1131263063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805de1f-9c62-4745-957b-df9804bb442d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:28Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dd674e-da6c-4c42-9e4d-879b597d7146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dd674e-da6c-4c42-9e4d-879b597d7146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ec2071-8ace-4083-8af8-2008a91a6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ec2071-8ace-4083-8af8-2008a91a6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e805de1f-9c62-4745-957b-df9804bb442d', 'volume_name': 'volume-e805de1f-9c62-4745-957b-df9804bb442d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a843be-518b-4051-aef6-20030ea0bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a843be-518b-4051-aef6-20030ea0bd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458a5573-fd26-4634-8480-f1e5004c3cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Volume e805de1f-9c62-4745-957b-df9804bb442d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e805de1f-9c62-4745-957b-df9804bb442d', 'volume_size': 1} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Created reservations ['a368a50c-9955-4db1-9206-bb9eb58eb89f', 'd6cafb2a-a7b2-43d1-a7d3-bbbb04a2bcf4', '75065f51-7ac0-42e8-a093-c2c4746b7205', '0b8bce36-845c-487b-8f53-f3f46e7082e3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:28 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:28 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:28 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.761s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:28 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a is being set with open permissions: ugo+rw Jul 09 01:23:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:28 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:28 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:28 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.651s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Deleted volume successfully. Jul 09 01:23:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-695f15c7-6db7-4a91-98f9-ff79bd44f62f tempest-VolumesNegativeTest-429716039 None] Lock "cinder-43c2db7f-27db-451b-8f05-f8357d809f71-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:29 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.696s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:29 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info Jul 09 01:23:29 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:29 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info" returned: 0 in 0.740s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:29 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info is being set with open permissions: ugo+rw Jul 09 01:23:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:29 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info Jul 09 01:23:29 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:30 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.info" returned: 0 in 0.645s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.722s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.696s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119938929',display_name='tempest-VolumesGetTest-Volume-1131263063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805de1f-9c62-4745-957b-df9804bb442d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8495d76a4bd46e6908e7ddec955a6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:28Z,use_quota=True,user_id='e75cfcd82219414f875dada2390ca337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Creating volume e805de1f-9c62-4745-957b-df9804bb442d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:23:30 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:23:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:30 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d 1073741824 Jul 09 01:23:30 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-18491d92-241c-4057-a183-0709d5ccb6f6 tempest-VolumesSnapshotListTestJSON-1193327402 None] Create snapshot completed successfully Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Flow 'volume_create_manager' (cbb2aec9-3c76-449c-9f53-0ae3dfd3982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e626d0-91ef-43ce-af0f-0153260488bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e626d0-91ef-43ce-af0f-0153260488bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-831530243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408a439f-f6f5-485c-ad31-610f55b8a5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69518b4c91f40bf8c42b322b52204c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:31Z,use_quota=True,user_id='66fb62756cdb422a987998acf763c968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84665e3e-ad0f-4172-8221-42c7f37c75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84665e3e-ad0f-4172-8221-42c7f37c75e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a241a-b0c7-463b-b8ad-ffb91d0669a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a241a-b0c7-463b-b8ad-ffb91d0669a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408a439f-f6f5-485c-ad31-610f55b8a5c4', 'volume_name': 'volume-408a439f-f6f5-485c-ad31-610f55b8a5c4', 'volume_size': 2}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562eaf1d-7679-4ba2-8410-2f68d4d00c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562eaf1d-7679-4ba2-8410-2f68d4d00c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162b22a-0294-4cf4-a424-01276bfe81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:31 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Volume 408a439f-f6f5-485c-ad31-610f55b8a5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408a439f-f6f5-485c-ad31-610f55b8a5c4', 'volume_size': 2} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:31 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d 1073741824" returned: 0 in 0.887s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:31 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d Jul 09 01:23:31 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:32 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d" returned: 0 in 0.637s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-831530243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408a439f-f6f5-485c-ad31-610f55b8a5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69518b4c91f40bf8c42b322b52204c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:23:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:23:31Z,use_quota=True,user_id='66fb62756cdb422a987998acf763c968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Creating volume 408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:23:32 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 2147483648 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458a5573-fd26-4634-8480-f1e5004c3cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e805de1f-9c62-4745-957b-df9804bb442d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:32 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 2147483648 Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49df840-4059-413f-9400-55b2b1f5e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:32 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:32 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Volume volume-e805de1f-9c62-4745-957b-df9804bb442d (e805de1f-9c62-4745-957b-df9804bb442d): created successfully Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49df840-4059-413f-9400-55b2b1f5e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:32 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Flow 'volume_create_manager' (ea324717-31c7-41e3-8056-f8777b29071e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f8827e83-dc9d-4aa2-a76a-c93d253d1a2f tempest-VolumesGetTest-1915079884 None] Created volume successfully. Jul 09 01:23:33 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 2147483648" returned: 0 in 0.836s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:33 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 Jul 09 01:23:33 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-e805de1f-9c62-4745-957b-df9804bb442d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "cinder-e805de1f-9c62-4745-957b-df9804bb442d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-e805de1f-9c62-4745-957b-df9804bb442d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-e805de1f-9c62-4745-957b-df9804bb442d" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1b224-3df0-4869-934d-84cc2170157f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:33 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d Jul 09 01:23:33 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:33 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4" returned: 0 in 0.641s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.288s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Creating offline snapshot 00708854-416c-46e7-819e-c43bece00d99 of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162b22a-0294-4cf4-a424-01276bfe81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408a439f-f6f5-485c-ad31-610f55b8a5c4', 'volume_size': 2}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f0cc38-4a52-41ec-b1c1-9a9ee4f31cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed38038-a3fd-4906-a848-69e4506cf4e7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:33 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:33 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Volume volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 (408a439f-f6f5-485c-ad31-610f55b8a5c4): created successfully Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f0cc38-4a52-41ec-b1c1-9a9ee4f31cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:23:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Flow 'volume_create_manager' (cbb2aec9-3c76-449c-9f53-0ae3dfd3982b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:23:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fc4e975d-7dfd-48fc-86ac-f2ceb7e871c6 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Created volume successfully. Jul 09 01:23:33 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:33 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:34 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d" returned: 0 in 0.812s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:34 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d Jul 09 01:23:34 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:34 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:34 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.921s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:34 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 1G Jul 09 01:23:34 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:34 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e805de1f-9c62-4745-957b-df9804bb442d" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-e805de1f-9c62-4745-957b-df9804bb442d" released by "delete_volume" :: held 1.551s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Created reservations ['5555e68b-bbe3-4cf4-8064-c79dae8c2b08', '0ac44508-6d6b-4c34-9b74-391797eddf00', '5dd4cf9e-04f3-4379-a7eb-4104c203868c', '54ba0613-a815-436c-9233-b42be17f7b40'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:34 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:34 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-23761e0d-a758-4177-95c7-9dd9393e062c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "cinder-23761e0d-a758-4177-95c7-9dd9393e062c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:35 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Acquiring lock "cinder-quobyte-23761e0d-a758-4177-95c7-9dd9393e062c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-23761e0d-a758-4177-95c7-9dd9393e062c" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e8746fb5-df68-4a15-bbf9-355f9c940458 tempest-VolumesGetTest-1915079884 None] Lock "cinder-e805de1f-9c62-4745-957b-df9804bb442d-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b18bc3-5c62-4b95-93aa-e84620d11227]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:35 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 1G" returned: 0 in 0.947s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:35 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:35 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:35 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:35 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:36 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.722s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:36 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 is being set with open permissions: ugo+rw Jul 09 01:23:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:36 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:36 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:36 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:36 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:36 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:37 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.688s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.407s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Creating offline snapshot 4033d4f7-dfff-4dd4-be90-9359f0e2992d of volume 408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a20667-13ac-4f96-9e49-b6ed0b762f09]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-07257172-624a-4c6f-8e8a-d1a8c54cb583 tempest-VolumesSnapshotListTestJSON-1193327402 None] Create snapshot completed successfully Jul 09 01:23:37 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 1 in 0.829s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:37 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c Jul 09 01:23:37 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:37 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 Jul 09 01:23:37 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:37 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-23761e0d-a758-4177-95c7-9dd9393e062c" returned: 0 in 0.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "cinder-quobyte-23761e0d-a758-4177-95c7-9dd9393e062c" released by "delete_volume" :: held 2.392s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:38 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4" returned: 0 in 0.843s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d 2G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:38 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d 2G Jul 09 01:23:38 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Created reservations ['103f2f45-8e60-4a2b-bd52-d1811d0c9bae', '4faf2545-a34a-4aa2-b80b-316341b8766e', 'bbfb6c9a-ccde-4cfe-841b-05eef5f33c0a', '39fe3d3a-754f-4d4b-93d3-001d68372940'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:38 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:38 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:38 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.667s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Deleted volume successfully. Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd92c2cf-1763-4b88-b004-7e688ed1dcad tempest-VolumesGetTest-1915079884 None] Lock "cinder-23761e0d-a758-4177-95c7-9dd9393e062c-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:38 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d 2G" returned: 0 in 0.921s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:38 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d Jul 09 01:23:38 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:39 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d" returned: 0 in 0.714s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:39 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d is being set with open permissions: ugo+rw Jul 09 01:23:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:39 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d Jul 09 01:23:39 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:40 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d" returned: 0 in 0.691s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:40 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info Jul 09 01:23:40 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:41 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:41 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info is being set with open permissions: ugo+rw Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:41 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info Jul 09 01:23:41 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:41 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.info" returned: 0 in 0.667s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.977s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Creating offline snapshot 6a4c1efd-5740-48d0-b573-6e0d5e60e03a of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd02a5c-6613-4872-a4bd-755db6d7e2c1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a6ad8e6d-f35f-4967-8542-463d7b011263 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Create snapshot completed successfully Jul 09 01:23:41 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:41 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "cinder-4033d4f7-dfff-4dd4-be90-9359f0e2992d-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-4033d4f7-dfff-4dd4-be90-9359f0e2992d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "cinder-quobyte-4033d4f7-dfff-4dd4-be90-9359f0e2992d" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-4033d4f7-dfff-4dd4-be90-9359f0e2992d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Deleting offline snapshot 4033d4f7-dfff-4dd4-be90-9359f0e2992d of volume 408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] snapshot_file for this snap is: volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d94ea9-4c40-4fcb-bff1-34a0dc09ca0f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:42 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d Jul 09 01:23:42 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:42 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:42 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a 1G Jul 09 01:23:42 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:43 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408a439f-f6f5-485c-ad31-610f55b8a5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87460b-8b13-4f99-aed9-2b1152e30a4e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:43 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 Jul 09 01:23:43 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:43 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a 1G" returned: 0 in 0.876s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:43 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a Jul 09 01:23:43 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:43 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4" returned: 0 in 0.831s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:44 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d Jul 09 01:23:44 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:44 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a" returned: 0 in 0.741s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:44 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a is being set with open permissions: ugo+rw Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:44 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a Jul 09 01:23:44 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:44 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d" returned: 0 in 0.851s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:44 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d Jul 09 01:23:44 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:45 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.320s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5620b5fd-a93b-4533-8ea7-84a5d35f3041 tempest-VolumesSnapshotListTestJSON-1193327402 None] Create snapshot completed successfully Jul 09 01:23:45 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4.4033d4f7-dfff-4dd4-be90-9359f0e2992d" returned: 0 in 0.775s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-4033d4f7-dfff-4dd4-be90-9359f0e2992d" released by "_delete_snapshot" :: held 3.407s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" released by "delete_snapshot" :: held 3.444s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Created reservations ['5d0bb184-175b-4ccd-ab34-375838546232', '50d240c7-98d2-495b-a044-14a7325eedad', 'ea02d12c-6e95-4760-8885-eef8d8faedb5', 'aa378973-9168-43ea-ae97-1807046e0b11'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Delete snapshot completed successfully. Jul 09 01:23:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a3f7348-4e91-4f3c-a2b2-f363ab8dc039 tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-4033d4f7-dfff-4dd4-be90-9359f0e2992d-delete_snapshot" released by "delete_snapshot" :: held 3.576s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "cinder-408a439f-f6f5-485c-ad31-610f55b8a5c4-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-408a439f-f6f5-485c-ad31-610f55b8a5c4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034eed1-8c58-4189-ae15-18b3da9df19b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:46 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 Jul 09 01:23:46 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-6a4c1efd-5740-48d0-b573-6e0d5e60e03a-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-6a4c1efd-5740-48d0-b573-6e0d5e60e03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-6a4c1efd-5740-48d0-b573-6e0d5e60e03a" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-6a4c1efd-5740-48d0-b573-6e0d5e60e03a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Deleting offline snapshot 6a4c1efd-5740-48d0-b573-6e0d5e60e03a of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] snapshot_file for this snap is: volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf7c1b-6e41-46df-a033-2f41858c45b5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:47 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a Jul 09 01:23:47 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:47 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4" returned: 0 in 1.066s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:47 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4 Jul 09 01:23:47 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:48 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3248c-7b94-46db-b91f-5431a8a115dc]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:48 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:48 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:48 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-408a439f-f6f5-485c-ad31-610f55b8a5c4" returned: 0 in 0.829s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-quobyte-408a439f-f6f5-485c-ad31-610f55b8a5c4" released by "delete_volume" :: held 2.005s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Created reservations ['db99f6d7-8dbd-4d83-8fdc-673fbde34cc9', 'fa2cd6ae-b586-45fb-8f3f-74da93271233', '9cca0023-e083-4aca-93be-2e70094fcb7d', '0bec5c68-a16d-4d7f-a23b-9e93fd70b1c8'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:23:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:48 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:23:48 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:49 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.934s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:49 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a Jul 09 01:23:49 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:49 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.745s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:23:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Deleted volume successfully. Jul 09 01:23:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03d68221-8660-46a8-a254-eb04f173e86c tempest-VolumesSnapshotNegativeTestJSON-314175478 None] Lock "cinder-408a439f-f6f5-485c-ad31-610f55b8a5c4-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:50 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a" returned: 0 in 0.914s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:50 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a Jul 09 01:23:50 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:51 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.6a4c1efd-5740-48d0-b573-6e0d5e60e03a" returned: 0 in 0.885s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-6a4c1efd-5740-48d0-b573-6e0d5e60e03a" released by "_delete_snapshot" :: held 3.918s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" released by "delete_snapshot" :: held 3.951s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=118,cinder:INSERT=35,cinder:SELECT=97,cinder:DELETE=12 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Created reservations ['20cd9d1e-eed2-4514-ab74-cbe57eb5372a', 'e7fc0e4a-50a7-462a-9cf9-f8e14c01959f', '35190ff1-3177-4c57-9847-66855ca19313', 'e2309214-9e87-4a7f-bd39-26db2b07a780'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Delete snapshot completed successfully. Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4230d2fc-7e0a-46ce-b791-1e34a17decc8 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-6a4c1efd-5740-48d0-b573-6e0d5e60e03a-delete_snapshot" released by "delete_snapshot" :: held 4.130s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-00708854-416c-46e7-819e-c43bece00d99-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-00708854-416c-46e7-819e-c43bece00d99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-00708854-416c-46e7-819e-c43bece00d99" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-00708854-416c-46e7-819e-c43bece00d99" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Deleting offline snapshot 00708854-416c-46e7-819e-c43bece00d99 of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] snapshot_file for this snap is: volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4c2ec-e3a7-4ea8-a615-1c965cff7572]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:51 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:51 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:52 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe307cda-7455-4d04-b0ba-d222db1b7363]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:52 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:52 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:53 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.887s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:53 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:53 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:54 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.938s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:54 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99 Jul 09 01:23:54 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:54 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.00708854-416c-46e7-819e-c43bece00d99" returned: 0 in 0.725s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-00708854-416c-46e7-819e-c43bece00d99" released by "_delete_snapshot" :: held 3.516s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" released by "delete_snapshot" :: held 3.548s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Created reservations ['831596b2-2d72-4fb0-87db-58524b395a16', 'e0fa0cc4-3ec8-4581-9e94-0e3416c76e4c', '714ada78-f7db-47e8-b705-7e65064f4cc1', '2a5f426b-4094-4bf8-bd82-504fbb9ce904'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Delete snapshot completed successfully. Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8125b283-3673-454e-b350-3c3fd6f93e29 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-00708854-416c-46e7-819e-c43bece00d99-delete_snapshot" released by "delete_snapshot" :: held 3.707s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-c2146e7f-7fdf-483b-ae84-8728b6ae724a-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-c2146e7f-7fdf-483b-ae84-8728b6ae724a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-c2146e7f-7fdf-483b-ae84-8728b6ae724a" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-c2146e7f-7fdf-483b-ae84-8728b6ae724a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Deleting offline snapshot c2146e7f-7fdf-483b-ae84-8728b6ae724a of volume 729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] snapshot_file for this snap is: volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d7b113-093c-46c2-b4be-d7e1dc09f441]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:55 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:55 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:56 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.927s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:23:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc408c1-91f2-42e7-a92d-e8889599ed17]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:23:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:56 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 Jul 09 01:23:56 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:57 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47" returned: 0 in 0.877s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:57 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:57 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:58 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.868s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:23:58 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a Jul 09 01:23:58 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:23:59 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 09 01:23:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47.c2146e7f-7fdf-483b-ae84-8728b6ae724a" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:23:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-c2146e7f-7fdf-483b-ae84-8728b6ae724a" released by "_delete_snapshot" :: held 3.549s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" released by "delete_snapshot" :: held 3.579s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:23:59 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Created reservations ['9058233e-52ee-41ee-8600-d5ff879ffc8f', '6705fcae-4ff3-4a42-a53a-6b28870fb3a4', '370ef07d-de01-4c28-8944-b6db186d2934', '13e03ae2-25b4-4fde-b788-a3a615b1aa3d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:23:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Delete snapshot completed successfully. Jul 09 01:23:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ce90a00c-f37b-4e4b-8137-e556452001bc tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-c2146e7f-7fdf-483b-ae84-8728b6ae724a-delete_snapshot" released by "delete_snapshot" :: held 3.741s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-729d8052-ac40-4b5d-b5a1-d167ce02bb47-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-729d8052-ac40-4b5d-b5a1-d167ce02bb47-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c3dd38-5862-4892-a932-e99d34481331]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:00 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 Jul 09 01:24:00 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:01 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47" returned: 0 in 0.945s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:01 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47 Jul 09 01:24:01 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:02 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-729d8052-ac40-4b5d-b5a1-d167ce02bb47" returned: 0 in 0.844s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-quobyte-729d8052-ac40-4b5d-b5a1-d167ce02bb47" released by "delete_volume" :: held 1.880s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Created reservations ['3c418c0a-97f3-4f00-8906-ed7b335830a1', 'fab36a80-06cf-4ef0-a2ed-f38004599d5e', 'b0f3a5b7-12bb-418e-891c-e6651c2857fd', 'b9bbc60a-a30e-4636-a1bd-cf3ed9313e91'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:02 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:24:02 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:03 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.853s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:03 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:24:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Deleted volume successfully. Jul 09 01:24:03 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=138,cinder:SELECT=108,cinder:INSERT=43,cinder:DELETE=10 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:24:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-69153074-dadd-47f9-a628-a7e198c9b320 tempest-VolumesSnapshotListTestJSON-1193327402 None] Lock "cinder-729d8052-ac40-4b5d-b5a1-d167ce02bb47-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:24:12 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:INSERT=7,cinder:UPDATE=24,cinder:SELECT=18 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Flow 'volume_create_manager' (79decbcf-b5b1-4f2d-ab21-ac3f539ea00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd709bc6-ca6a-4f05-b230-b769db5abe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd709bc6-ca6a-4f05-b230-b769db5abe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-318160919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b52b701-468e-427a-8e06-13a8a56a44e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6393ba3a74984c7fbf6b573029f3aff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:27Z,use_quota=True,user_id='46b2332d82ac478e82aca1b4fc11f694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a81ba68-045c-420a-b906-a7904e34c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a81ba68-045c-420a-b906-a7904e34c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b28bbb-f58a-47a3-a054-ae78c379cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b28bbb-f58a-47a3-a054-ae78c379cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b52b701-468e-427a-8e06-13a8a56a44e4', 'volume_name': 'volume-4b52b701-468e-427a-8e06-13a8a56a44e4', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffdcb03-73c8-4df1-9ac0-80e214ae01d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffdcb03-73c8-4df1-9ac0-80e214ae01d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7029fe3-1264-464f-ab59-9fed8badfab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Volume 4b52b701-468e-427a-8e06-13a8a56a44e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b52b701-468e-427a-8e06-13a8a56a44e4', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 01:24:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Trying to clone 4b52b701-468e-427a-8e06-13a8a56a44e4 from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:24:28 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:24:28 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Image download 20.69 MB at 20.69 MB/s Jul 09 01:24:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7deae4b-daf4-4eaa-9b0a-74b5cd114a6c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:28 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD Jul 09 01:24:28 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:29 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD" returned: 0 in 0.934s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:29 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 is fetched for user 46b2332d82ac478e82aca1b4fc11f694. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:24:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[172546dd-0762-45c7-bc7e-f3c291688c98]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:29 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD Jul 09 01:24:29 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:30 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD" returned: 0 in 1.324s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-318160919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b52b701-468e-427a-8e06-13a8a56a44e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6393ba3a74984c7fbf6b573029f3aff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:27Z,use_quota=True,user_id='46b2332d82ac478e82aca1b4fc11f694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Creating volume 4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:24:30 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:24:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:30 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1073741824 Jul 09 01:24:30 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:31 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1073741824" returned: 0 in 1.196s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:31 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:31 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:32 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 1.086s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:32 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:24:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:32 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Attempting download of 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 4b52b701-468e-427a-8e06-13a8a56a44e4. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08855b8f-289b-43da-9892-8fd72257fee8]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:33 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk Jul 09 01:24:33 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:33 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:24:33 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Flow 'volume_create_manager' (97b66bde-4769-479d-82df-d59c97daf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e332184-9b35-4875-aa0a-96583a3d0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:33 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk" returned: 0 in 0.996s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e332184-9b35-4875-aa0a-96583a3d0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1263521780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf30e0c-af63-451d-b369-502c7b90b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9e08f0b0444079a78117cd4e3ce72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:34Z,use_quota=True,user_id='e0f75d1680cb4fe582a5b4a94f19b8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e383f5-39f4-49ce-9042-4719505b3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e383f5-39f4-49ce-9042-4719505b3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f9f68d-3676-4b58-882a-32dc8a259bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f9f68d-3676-4b58-882a-32dc8a259bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf30e0c-af63-451d-b369-502c7b90b4a0', 'volume_name': 'volume-edf30e0c-af63-451d-b369-502c7b90b4a0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd529da-ed67-4298-820b-d3a7fa77029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd529da-ed67-4298-820b-d3a7fa77029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0b0a9-daa5-4087-aab7-3b4adc911f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:34 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Volume edf30e0c-af63-451d-b369-502c7b90b4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf30e0c-af63-451d-b369-502c7b90b4a0', 'volume_size': 1} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1263521780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf30e0c-af63-451d-b369-502c7b90b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9e08f0b0444079a78117cd4e3ce72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:34Z,use_quota=True,user_id='e0f75d1680cb4fe582a5b4a94f19b8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Creating volume edf30e0c-af63-451d-b369-502c7b90b4a0 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:24:34 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:34 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 1073741824 Jul 09 01:24:34 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:34 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk Jul 09 01:24:34 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:34 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.165s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:24:35 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk" returned: 1 in 1.451s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52f835e6-23a6-4938-9b95-f63e8048dcd3_q9la2uqk' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f56ba-0ce9-48bd-a775-bc20168ed292]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:35 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 1073741824" returned: 0 in 1.418s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:35 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD Jul 09 01:24:35 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:35 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 Jul 09 01:24:35 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:36 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] 52f835e6-23a6-4938-9b95-f63e8048dcd3 was qcow2, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:36 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:36 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:36 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0b0a9-daa5-4087-aab7-3b4adc911f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf30e0c-af63-451d-b369-502c7b90b4a0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cdd598-8b90-4558-94ed-feb004e5c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Volume volume-edf30e0c-af63-451d-b369-502c7b90b4a0 (edf30e0c-af63-451d-b369-502c7b90b4a0): created successfully Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cdd598-8b90-4558-94ed-feb004e5c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Flow 'volume_create_manager' (97b66bde-4769-479d-82df-d59c97daf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9c0602fe-4ebd-4a2d-900b-1ff8180d8e3d tempest-TestMinimumBasicScenario-1585701438 None] Created volume successfully. Jul 09 01:24:37 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (5f53c1c1-3da8-4c85-927e-f7b41c296e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d39d34c-f342-444f-8caf-92b042e71071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d39d34c-f342-444f-8caf-92b042e71071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1294602757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22092ecb-9c38-4603-8f9b-f88c06347a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:38Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e85dd7ba-6ff9-4534-8a88-7a40587c5ccd),volume_type_id=e85dd7ba-6ff9-4534-8a88-7a40587c5ccd)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d178a1-6786-4be7-94a8-c5bbef2f70af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d178a1-6786-4be7-94a8-c5bbef2f70af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf8918a-adcb-40b6-a079-60a9e9a9d20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf8918a-adcb-40b6-a079-60a9e9a9d20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22092ecb-9c38-4603-8f9b-f88c06347a6e', 'volume_name': 'volume-22092ecb-9c38-4603-8f9b-f88c06347a6e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3607c558-1eed-425e-b635-2c26a3fbe698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3607c558-1eed-425e-b635-2c26a3fbe698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e356c1d-4a59-4add-bb31-0314b12f43d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume 22092ecb-9c38-4603-8f9b-f88c06347a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22092ecb-9c38-4603-8f9b-f88c06347a6e', 'volume_size': 1} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1294602757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22092ecb-9c38-4603-8f9b-f88c06347a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:38Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e85dd7ba-6ff9-4534-8a88-7a40587c5ccd),volume_type_id=e85dd7ba-6ff9-4534-8a88-7a40587c5ccd)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Creating volume 22092ecb-9c38-4603-8f9b-f88c06347a6e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:24:38 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:38 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e 1073741824 Jul 09 01:24:38 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (e79e4be1-9db9-4cb7-beca-bb406f266607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba7cc7-0889-4eca-ba7f-9dde2971a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba7cc7-0889-4eca-ba7f-9dde2971a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-112150868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5274977-6670-4c5c-b03f-d645bb808a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:39Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(478aa77d-291a-4e21-95d3-8ac0fb0bedcc),volume_type_id=478aa77d-291a-4e21-95d3-8ac0fb0bedcc)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b74d59-d244-4fc3-99f5-ac5892e72c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b74d59-d244-4fc3-99f5-ac5892e72c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3b3aeb-e16b-43aa-8125-a406aa125a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3b3aeb-e16b-43aa-8125-a406aa125a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5274977-6670-4c5c-b03f-d645bb808a0d', 'volume_name': 'volume-c5274977-6670-4c5c-b03f-d645bb808a0d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21133024-bbfb-4621-990f-52ee4272547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21133024-bbfb-4621-990f-52ee4272547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae4a3bc-d583-4362-88d0-8f993ec9b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume c5274977-6670-4c5c-b03f-d645bb808a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5274977-6670-4c5c-b03f-d645bb808a0d', 'volume_size': 1} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:39 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 2.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52f835e6-23a6-4938-9b95-f63e8048dcd3_luqrdkn3devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:24:39 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Converted 112.00 MB image at 41.03 MB/s Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:39 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1G Jul 09 01:24:39 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:39 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e 1073741824" returned: 0 in 1.327s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:39 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e Jul 09 01:24:39 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (d59a864f-2b9f-46bb-8395-74553650accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eb5f21-0b74-465c-8ba7-ac432feacba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eb5f21-0b74-465c-8ba7-ac432feacba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1916289100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7117d5-6e08-4f4d-8bda-2a56b3d3491d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:40Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5f1358d-e4ad-4061-a32f-3e951c9f2d79),volume_type_id=d5f1358d-e4ad-4061-a32f-3e951c9f2d79)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb57a3a-5784-4359-a89b-99fbd081e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb57a3a-5784-4359-a89b-99fbd081e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c658e-d7da-4797-9843-60b2da63bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:39 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c658e-d7da-4797-9843-60b2da63bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f7117d5-6e08-4f4d-8bda-2a56b3d3491d', 'volume_name': 'volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d', 'volume_size': 1, 'image_id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1432480743', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3a282bfdf774abcb84cb2660d7ec4c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'created_at': datetime.datetime(2026, 7, 8, 23, 24, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 24, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6854fa-6576-4e81-af19-585530838a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6854fa-6576-4e81-af19-585530838a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de08ad8f-ad0d-44cc-b978-6412d094ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d', 'volume_size': 1, 'image_id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1432480743', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3a282bfdf774abcb84cb2660d7ec4c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'created_at': datetime.datetime(2026, 7, 8, 23, 24, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 24, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372/file', 'properties': {}}, 'image_service': } Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Trying to clone 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d from image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:24:40 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 1G" returned: 0 in 1.340s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a30129-c725-44b0-83b7-49fef5041fa2]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:40 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:40 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:40 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e" returned: 0 in 1.313s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-112150868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5274977-6670-4c5c-b03f-d645bb808a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:39Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(478aa77d-291a-4e21-95d3-8ac0fb0bedcc),volume_type_id=478aa77d-291a-4e21-95d3-8ac0fb0bedcc)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Creating volume c5274977-6670-4c5c-b03f-d645bb808a0d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:24:40 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e356c1d-4a59-4add-bb31-0314b12f43d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22092ecb-9c38-4603-8f9b-f88c06347a6e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af295a58-36c0-4cf9-b3df-65aea53758e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume volume-22092ecb-9c38-4603-8f9b-f88c06347a6e (22092ecb-9c38-4603-8f9b-f88c06347a6e): created successfully Jul 09 01:24:40 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d 1073741824 Jul 09 01:24:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af295a58-36c0-4cf9-b3df-65aea53758e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:40 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (5f53c1c1-3da8-4c85-927e-f7b41c296e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c138d177-ba77-4a7c-b816-8db1b13ba860 tempest-TestInstancesWithCinderVolumes-1995904314 None] Created volume successfully. Jul 09 01:24:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:41 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 1.247s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:41 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:41 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:42 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d 1073741824" returned: 0 in 1.376s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:42 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d Jul 09 01:24:42 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:42 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 1 in 0.928s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Downloaded image 52f835e6-23a6-4938-9b95-f63e8048dcd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}])) to volume 4b52b701-468e-427a-8e06-13a8a56a44e4 successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Temporary image 52f835e6-23a6-4938-9b95-f63e8048dcd3 for user 46b2332d82ac478e82aca1b4fc11f694 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Marking volume 4b52b701-468e-427a-8e06-13a8a56a44e4 as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Copying metadata from image 52f835e6-23a6-4938-9b95-f63e8048dcd3 to 4b52b701-468e-427a-8e06-13a8a56a44e4. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Creating volume glance metadata for volume 4b52b701-468e-427a-8e06-13a8a56a44e4 backed by image 52f835e6-23a6-4938-9b95-f63e8048dcd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7029fe3-1264-464f-ab59-9fed8badfab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b52b701-468e-427a-8e06-13a8a56a44e4', 'volume_size': 1, 'image_id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52f835e6-23a6-4938-9b95-f63e8048dcd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5bc622a936c048e3834f6382c6d10633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52f835e6-23a6-4938-9b95-f63e8048dcd3', 'created_at': datetime.datetime(2026, 7, 8, 23, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52f835e6-23a6-4938-9b95-f63e8048dcd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a121c8ef-9656-49cc-940f-0f33a8bb7fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Volume volume-4b52b701-468e-427a-8e06-13a8a56a44e4 (4b52b701-468e-427a-8e06-13a8a56a44e4): created successfully Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a121c8ef-9656-49cc-940f-0f33a8bb7fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Flow 'volume_create_manager' (79decbcf-b5b1-4f2d-ab21-ac3f539ea00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-409908fa-bcb1-4379-9b0c-30717b530e6e tempest-TestShelveInstance-504329885 None] Created volume successfully. Jul 09 01:24:43 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.980s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae4a3bc-d583-4362-88d0-8f993ec9b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5274977-6670-4c5c-b03f-d645bb808a0d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fd129-5c2b-464c-af51-281842bab22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567af85-5247-40fa-81ff-a3c73eab74c9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume volume-c5274977-6670-4c5c-b03f-d645bb808a0d (c5274977-6670-4c5c-b03f-d645bb808a0d): created successfully Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fd129-5c2b-464c-af51-281842bab22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (e79e4be1-9db9-4cb7-beca-bb406f266607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d21b1e94-3296-4fd8-a4a3-0a96eea03c9b tempest-TestInstancesWithCinderVolumes-1995904314 None] Created volume successfully. Jul 09 01:24:43 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 Jul 09 01:24:43 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:43 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-edf30e0c-af63-451d-b369-502c7b90b4a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e995997-c755-4fa3-b582-a6a03c3d81c1', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:24:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-cfee54ce-bc10-4161-b100-d4ddf140b967 req-853cee5d-53f3-4352-9fd6-025d3482a78b tempest-TestMinimumBasicScenario-1585701438 None] attachment_update completed successfully. Jul 09 01:24:44 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD, size 20.69 MB, duration 4.41 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:24:44 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Image download 20.69 MB at 4.69 MB/s Jul 09 01:24:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c95751-9739-4fc0-b7b5-1ec7b00f218e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:44 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD Jul 09 01:24:44 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:45 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:45 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Temporary image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 is fetched for user 453f059912934503a109e2d6ce6a4d8a. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:24:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[821288f5-736d-4657-b397-125558affea1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:45 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD Jul 09 01:24:45 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:46 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1916289100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7117d5-6e08-4f4d-8bda-2a56b3d3491d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a282bfdf774abcb84cb2660d7ec4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:24:40Z,use_quota=True,user_id='453f059912934503a109e2d6ce6a4d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5f1358d-e4ad-4061-a32f-3e951c9f2d79),volume_type_id=d5f1358d-e4ad-4061-a32f-3e951c9f2d79)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Creating volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:24:46 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:24:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:46 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1073741824 Jul 09 01:24:46 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:47 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1073741824" returned: 0 in 0.853s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:47 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:24:47 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:47 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Attempting download of 2fa8e64b-93f8-42de-a94e-d872fe3c9372 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}])) to volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ebdc65-2c54-4408-bf60-d60b790a4f35]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:48 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym Jul 09 01:24:48 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:48 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym" returned: 0 in 0.771s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:48 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym Jul 09 01:24:48 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:49 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym" returned: 1 in 0.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa8e64b-93f8-42de-a94e-d872fe3c9372_xegf42ym' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:24:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ef541-8144-400c-9c7d-b60542e2e543]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:49 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD Jul 09 01:24:49 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:50 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:50 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] 2fa8e64b-93f8-42de-a94e-d872fe3c9372 was qcow2, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:24:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:50 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:24:50 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:24:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:24:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfcd0e5-86b8-48db-b38b-28dd089fc1ae]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:52 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:52 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:53 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 1.297s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:53 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 3.043s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:53 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fa8e64b-93f8-42de-a94e-d872fe3c9372_ve1co_vjdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:24:53 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Converted 112.00 MB image at 36.76 MB/s Jul 09 01:24:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:53 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1G Jul 09 01:24:53 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:53 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:24:53 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:54 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d 1G" returned: 0 in 0.872s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deee6fe-9769-46a7-a570-477a95149a4c]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:54 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 1 in 0.949s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.324s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:24:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-4b52b701-468e-427a-8e06-13a8a56a44e4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be6c8cd5-ff54-42a3-bff4-e930ba5d9ee9', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:24:54 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:24:54 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-538b5d84-53f5-4a51-85a9-5d6dcdc125d9 req-103dd43e-ed0d-4518-84a8-0501ce4a2ce3 tempest-TestShelveInstance-504329885 None] attachment_update completed successfully. Jul 09 01:24:55 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 0.837s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:24:55 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:24:55 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:24:56 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 1 in 0.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Downloaded image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}])) to volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Temporary image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 for user 453f059912934503a109e2d6ce6a4d8a is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Marking volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Copying metadata from image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 to 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Creating volume glance metadata for volume 5f7117d5-6e08-4f4d-8bda-2a56b3d3491d backed by image 2fa8e64b-93f8-42de-a94e-d872fe3c9372 with: {'image_id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'image_name': 'tempest-scenario-img--1432480743', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de08ad8f-ad0d-44cc-b978-6412d094ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d', 'volume_size': 1, 'image_id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1432480743', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3a282bfdf774abcb84cb2660d7ec4c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa8e64b-93f8-42de-a94e-d872fe3c9372', 'created_at': datetime.datetime(2026, 7, 8, 23, 24, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 24, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa8e64b-93f8-42de-a94e-d872fe3c9372/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2154a9-1a01-4d19-a736-fa2ca20f9046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:24:56 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Volume volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d (5f7117d5-6e08-4f4d-8bda-2a56b3d3491d): created successfully Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2154a9-1a01-4d19-a736-fa2ca20f9046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:24:56 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Flow 'volume_create_manager' (d59a864f-2b9f-46bb-8395-74553650accf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:24:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-dafca7d7-543f-40f8-9ffd-08d797c91d6a tempest-TestInstancesWithCinderVolumes-1995904314 None] Created volume successfully. Jul 09 01:25:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721f876-0bba-4400-bffe-b546c50d6131]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:25:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:05 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:25:05 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:06 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 1.104s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:06 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=34,cinder:UPDATE=26,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:25:06 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:25:06 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:07 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 1 in 0.891s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:25:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.081s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b4d6a56-1e3d-4a3b-bab7-e4d3e1c7b381', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:25:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-aef64dd9-01df-40c9-9129-954848583b36 req-28d1eed7-d75e-4f4a-8ce6-6679423bb4fd tempest-TestInstancesWithCinderVolumes-1995904314 None] attachment_update completed successfully. Jul 09 01:25:17 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=18,cinder:DELETE=4 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:25:17 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:25:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-b177b60e-e40d-449b-b8e3-437fa5d7135c req-ccce313e-cea9-4258-a235-2fa53e01d437 tempest-TestShelveInstance-504329885 None] Terminate volume connection completed successfully. Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-b177b60e-e40d-449b-b8e3-437fa5d7135c req-ccce313e-cea9-4258-a235-2fa53e01d437 tempest-TestShelveInstance-504329885 None] Deleting attachment be6c8cd5-ff54-42a3-bff4-e930ba5d9ee9. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:33 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:25:33 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:34 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:25:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:25:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:25:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:25:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-63f9322a-ef47-4f4a-ade3-742abeb009e6 req-6cbb71d4-158c-463a-8f94-233bfbba2b17 tempest-TestMinimumBasicScenario-1585701438 None] Terminate volume connection completed successfully. Jul 09 01:25:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-63f9322a-ef47-4f4a-ade3-742abeb009e6 req-6cbb71d4-158c-463a-8f94-233bfbba2b17 tempest-TestMinimumBasicScenario-1585701438 None] Deleting attachment 5e995997-c755-4fa3-b582-a6a03c3d81c1. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:25:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0566915-2697-42ad-bb06-02055ce97786]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:25:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:38 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:25:38 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "cinder-edf30e0c-af63-451d-b369-502c7b90b4a0-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "cinder-edf30e0c-af63-451d-b369-502c7b90b4a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:25:39 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 0.892s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "cinder-quobyte-edf30e0c-af63-451d-b369-502c7b90b4a0" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "cinder-quobyte-edf30e0c-af63-451d-b369-502c7b90b4a0" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a6535-cfc0-4a39-a12d-8a31842042f7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:25:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:39 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:25:39 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:39 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 Jul 09 01:25:39 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:40 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 1 in 0.826s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.764s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-4b52b701-468e-427a-8e06-13a8a56a44e4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aed5b687-a201-4343-8e26-77402edd7289', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:25:40 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-28c727e5-6a3f-4a82-b732-55502227d6ce req-2debf6d9-787c-45f1-8847-8c5577679fb3 tempest-TestShelveInstance-504329885 None] attachment_update completed successfully. Jul 09 01:25:40 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0" returned: 0 in 0.887s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:40 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0 Jul 09 01:25:40 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:41 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-edf30e0c-af63-451d-b369-502c7b90b4a0" returned: 0 in 0.722s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "cinder-quobyte-edf30e0c-af63-451d-b369-502c7b90b4a0" released by "delete_volume" :: held 1.659s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Created reservations ['77e26274-387e-4fc8-8efe-027d19131592', 'cb422257-7464-4b05-bbc8-b0b7bd646d98', 'c49d4bdb-0579-4da7-8848-02cc0798604b', '2d00683f-817d-4322-b32c-5dcb264cdd51'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:41 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:25:41 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:41 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.684s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:25:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Deleted volume successfully. Jul 09 01:25:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fca2d651-780e-4f62-b283-9313a5572a8f tempest-TestMinimumBasicScenario-1585701438 None] Lock "cinder-edf30e0c-af63-451d-b369-502c7b90b4a0-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:25:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d6be7-846a-40f1-8347-2b8a0dce515d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:25:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:45 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e Jul 09 01:25:45 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:46 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e" returned: 0 in 0.797s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-22092ecb-9c38-4603-8f9b-f88c06347a6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '373f834b-c562-4c29-b645-bf1d3e5ddf42', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:25:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-c1b20559-dee0-47d8-88f6-861ea70aafb3 req-ba16af69-0dc0-4f1c-aa80-958c115563bc tempest-TestInstancesWithCinderVolumes-1995904314 None] attachment_update completed successfully. Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2af7f8-928d-4929-9a48-313a7ce7db02]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:25:54 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d Jul 09 01:25:54 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:25:54 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d" returned: 0 in 0.913s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:25:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:25:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-c5274977-6670-4c5c-b03f-d645bb808a0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bff18b1c-1b00-4e15-a65e-d0397f9ae670', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:25:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-54908e89-5823-427f-bdd0-6eac9a357a42 req-8ad7c917-03fc-43ad-8b3b-16399a2c51c8 tempest-TestInstancesWithCinderVolumes-1995904314 None] attachment_update completed successfully. Jul 09 01:26:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-faec7d91-007f-4058-9eb0-d6e362bec41b req-26a650f9-4583-406a-ac77-11c24ada7453 tempest-TestInstancesWithCinderVolumes-1995904314 None] Terminate volume connection completed successfully. Jul 09 01:26:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-faec7d91-007f-4058-9eb0-d6e362bec41b req-26a650f9-4583-406a-ac77-11c24ada7453 tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleting attachment 373f834b-c562-4c29-b645-bf1d3e5ddf42. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:26:05 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=26,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:26:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-22092ecb-9c38-4603-8f9b-f88c06347a6e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-22092ecb-9c38-4603-8f9b-f88c06347a6e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-quobyte-22092ecb-9c38-4603-8f9b-f88c06347a6e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-22092ecb-9c38-4603-8f9b-f88c06347a6e" acquired by "delete_volume" :: waited 0.033s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:07 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3199f6-d56f-4bbd-afab-9c8f16141174]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:26:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:07 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e Jul 09 01:26:07 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:08 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e" returned: 0 in 1.334s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:08 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e Jul 09 01:26:08 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:09 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-22092ecb-9c38-4603-8f9b-f88c06347a6e" returned: 0 in 1.020s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-22092ecb-9c38-4603-8f9b-f88c06347a6e" released by "delete_volume" :: held 2.427s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:09 devstack cinder-volume[86954]: WARNING cinder.quota [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-647337931-302279014 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-647337931-302279014, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:09 devstack cinder-volume[86954]: WARNING cinder.quota [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-647337931-302279014 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-647337931-302279014, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Created reservations ['f348b9ef-76d9-44e2-bc26-46ce7abe2b2b', '15998400-1748-4cac-b7e8-937a4aca7cac', 'b681b2cf-1825-4fef-8c33-6f92499dd951', 'adf5224b-dd6e-4fd9-937f-91739bd88ac5'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:26:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:09 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:26:09 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:10 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.779s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:10 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:26:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleted volume successfully. Jul 09 01:26:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8bfa39dd-9491-4e4b-b505-7ff8fe23582e tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-22092ecb-9c38-4603-8f9b-f88c06347a6e-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:12 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-b260d1d0-d59c-480e-a375-1021121ac73d req-0dc18cd9-d31b-4afd-a6ff-80bf9f2b72d4 tempest-TestInstancesWithCinderVolumes-1995904314 None] Terminate volume connection completed successfully. Jul 09 01:26:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-b260d1d0-d59c-480e-a375-1021121ac73d req-0dc18cd9-d31b-4afd-a6ff-80bf9f2b72d4 tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleting attachment bff18b1c-1b00-4e15-a65e-d0397f9ae670. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-c5274977-6670-4c5c-b03f-d645bb808a0d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-c5274977-6670-4c5c-b03f-d645bb808a0d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-quobyte-c5274977-6670-4c5c-b03f-d645bb808a0d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-c5274977-6670-4c5c-b03f-d645bb808a0d" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6b341-2763-4f5a-881d-7123e2eb7517]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:26:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:14 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d Jul 09 01:26:14 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:15 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:15 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d Jul 09 01:26:15 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:16 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c5274977-6670-4c5c-b03f-d645bb808a0d" returned: 0 in 0.743s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-c5274977-6670-4c5c-b03f-d645bb808a0d" released by "delete_volume" :: held 1.616s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:16 devstack cinder-volume[86954]: WARNING cinder.quota [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1953200172-173233661 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1953200172-173233661, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:16 devstack cinder-volume[86954]: WARNING cinder.quota [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1953200172-173233661 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1953200172-173233661, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Created reservations ['df955a79-654c-44f1-9b2d-7e95d7872346', 'de1b19e2-6b0c-4540-8ce2-c7c304242509', '15c1f3e7-acc3-4de4-8645-d92d275c1bd0', '52733aae-c687-439d-9e09-145a7ca79200'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:26:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:16 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:26:16 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:17 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.842s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:26:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleted volume successfully. Jul 09 01:26:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0a13208f-8e92-494f-b58d-23bee1a304e2 tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-c5274977-6670-4c5c-b03f-d645bb808a0d-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-9125144b-8900-49a6-9aac-e26942b5fff6 req-b36aac8b-d19d-4c9c-a34e-c4cefdb2cc1f tempest-TestInstancesWithCinderVolumes-1995904314 None] Terminate volume connection completed successfully. Jul 09 01:26:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-9125144b-8900-49a6-9aac-e26942b5fff6 req-b36aac8b-d19d-4c9c-a34e-c4cefdb2cc1f tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleting attachment 6b4d6a56-1e3d-4a3b-bab7-e4d3e1c7b381. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "cinder-quobyte-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7142c90-3acf-4750-99ee-d0b173bdd23f]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:26:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:26 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:26:26 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:27 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 0.752s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:27 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:26:27 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:28 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 1 in 0.802s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:28 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d Jul 09 01:26:28 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:28 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" returned: 0 in 0.647s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-quobyte-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d" released by "delete_volume" :: held 2.264s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=40,cinder:UPDATE=29,cinder:INSERT=8 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:26:28 devstack cinder-volume[86954]: WARNING cinder.quota [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486218547-314400662 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486218547-314400662, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:28 devstack cinder-volume[86954]: WARNING cinder.quota [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486218547-314400662 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486218547-314400662, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Created reservations ['edc28815-e3e4-49a0-bfe0-927840ecad01', 'b655ffa7-3c1f-42ac-ac7a-e10c3e3e8918', 'd4ddb2ed-36f1-448d-9e29-5fe07e8ebb6f', 'a5728ab3-d019-4879-9f4f-68e6f34e7599'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:26:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:29 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:26:29 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:29 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.644s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:26:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Deleted volume successfully. Jul 09 01:26:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-87fc57e7-c417-4e15-acb6-363ae073b9ea tempest-TestInstancesWithCinderVolumes-1995904314 None] Lock "cinder-5f7117d5-6e08-4f4d-8bda-2a56b3d3491d-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:26:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:33 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:26:33 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:34 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.903s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:26:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:26:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:26:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:26:36 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-fc32144a-feae-4348-9426-6bf89391f0a1 tempest-TestShelveInstance-504329885 None] Terminate volume connection completed successfully. Jul 09 01:26:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-fc32144a-feae-4348-9426-6bf89391f0a1 tempest-TestShelveInstance-504329885 None] Deleting attachment aed5b687-a201-4343-8e26-77402edd7289. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Acquiring lock "cinder-4b52b701-468e-427a-8e06-13a8a56a44e4-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "cinder-4b52b701-468e-427a-8e06-13a8a56a44e4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Acquiring lock "cinder-quobyte-4b52b701-468e-427a-8e06-13a8a56a44e4" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "cinder-quobyte-4b52b701-468e-427a-8e06-13a8a56a44e4" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[45782d16-93a3-4d54-84d3-f970b44fd57c]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:26:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:37 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:26:37 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:38 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 1.017s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:38 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:26:38 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:39 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 1 in 1.172s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:26:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:39 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4 Jul 09 01:26:39 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:40 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4b52b701-468e-427a-8e06-13a8a56a44e4" returned: 0 in 1.039s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "cinder-quobyte-4b52b701-468e-427a-8e06-13a8a56a44e4" released by "delete_volume" :: held 3.362s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG cinder.quota [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Created reservations ['4d53bf5e-809f-4a21-a771-fc41bc18b2d0', 'de99f7d7-a50b-4bc9-9f44-0ea22eaaa36e', '84edcde0-5388-4047-98c6-59d809b71dcf', 'a328611b-d04a-484e-b58b-2f772d61d652'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:26:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:26:40 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:26:40 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:26:41 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 09 01:26:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.130s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:26:41 devstack cinder-volume[86954]: DEBUG cinder.manager [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:26:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Deleted volume successfully. Jul 09 01:26:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [req-6a4bd70b-1b43-4b46-acfc-5eeb6f7a88ef req-6e1d65e6-820f-4087-87f5-6171d172c360 tempest-TestShelveInstance-504329885 None] Lock "cinder-4b52b701-468e-427a-8e06-13a8a56a44e4-delete_volume" released by "delete_volume" :: held 4.806s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:26:50 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:INSERT=4,cinder:UPDATE=12,cinder:SELECT=8,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:26:52 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=37,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Flow 'volume_create_manager' (50b566e1-41fe-471f-8de7-17f01e7967ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad2d3ec-d8f1-4126-8e72-21c1a1c6bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad2d3ec-d8f1-4126-8e72-21c1a1c6bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-359620842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49be809-30df-41a5-86a8-83f09ea84857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e399ab2f904504898a9cfc2e97f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:04Z,use_quota=True,user_id='eca5752435344b44aba48a8d83314a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982e77a-3c70-42ca-9e12-0699d92149b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982e77a-3c70-42ca-9e12-0699d92149b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e933d4-4192-4800-b03b-cd7740fedf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e933d4-4192-4800-b03b-cd7740fedf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49be809-30df-41a5-86a8-83f09ea84857', 'volume_name': 'volume-b49be809-30df-41a5-86a8-83f09ea84857', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585ddba7-7dd2-4e86-8d7d-cee4e69f4d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585ddba7-7dd2-4e86-8d7d-cee4e69f4d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec9bb5-29b4-4797-a2ad-44b47936bec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Volume b49be809-30df-41a5-86a8-83f09ea84857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49be809-30df-41a5-86a8-83f09ea84857', 'volume_size': 1} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-359620842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49be809-30df-41a5-86a8-83f09ea84857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e399ab2f904504898a9cfc2e97f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:04Z,use_quota=True,user_id='eca5752435344b44aba48a8d83314a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Creating volume b49be809-30df-41a5-86a8-83f09ea84857 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:27:04 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:27:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:04 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 1073741824 Jul 09 01:27:04 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:05 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 1073741824" returned: 0 in 0.980s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:05 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 Jul 09 01:27:05 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:05 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857" returned: 0 in 0.768s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec9bb5-29b4-4797-a2ad-44b47936bec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49be809-30df-41a5-86a8-83f09ea84857', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3efb5-0262-4f8f-ac94-d6b80fe71416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:05 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Volume volume-b49be809-30df-41a5-86a8-83f09ea84857 (b49be809-30df-41a5-86a8-83f09ea84857): created successfully Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3efb5-0262-4f8f-ac94-d6b80fe71416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:05 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Flow 'volume_create_manager' (50b566e1-41fe-471f-8de7-17f01e7967ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2a7e7399-f6ab-44f4-9ab0-a0bf9bd78577 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Created volume successfully. Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Flow 'volume_create_manager' (7f904361-198c-4a1d-bf4f-7c867815b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18db0d7d-d621-4619-a05b-3f9e568e47e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18db0d7d-d621-4619-a05b-3f9e568e47e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2004518966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac30bbdb-26af-4b79-a72d-5b280025833b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd04380efeb491b82c3c501e68145f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:06Z,use_quota=True,user_id='a17d6f28c486446b929fb5ac4b2b2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd7fca-d40a-48dd-b2fc-78cc9d63c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd7fca-d40a-48dd-b2fc-78cc9d63c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d51e2a4-934f-4664-a750-c38ce46e43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d51e2a4-934f-4664-a750-c38ce46e43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac30bbdb-26af-4b79-a72d-5b280025833b', 'volume_name': 'volume-ac30bbdb-26af-4b79-a72d-5b280025833b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d76af46-868f-482f-969b-f964d23546df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d76af46-868f-482f-969b-f964d23546df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a547378-fa54-487f-8f72-b96610889679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume ac30bbdb-26af-4b79-a72d-5b280025833b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac30bbdb-26af-4b79-a72d-5b280025833b', 'volume_size': 1} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2004518966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac30bbdb-26af-4b79-a72d-5b280025833b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd04380efeb491b82c3c501e68145f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:06Z,use_quota=True,user_id='a17d6f28c486446b929fb5ac4b2b2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Creating volume ac30bbdb-26af-4b79-a72d-5b280025833b {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:27:06 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:06 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b 1073741824 Jul 09 01:27:06 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Flow 'volume_create_manager' (91c711eb-846d-4918-98e8-4d7c52338c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d3fb2-7ec0-437d-92da-1b5ab97cb398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d3fb2-7ec0-437d-92da-1b5ab97cb398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615812658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f43ad2-1719-4f70-99b1-ff2ecc5bf479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd04380efeb491b82c3c501e68145f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:07Z,use_quota=True,user_id='a17d6f28c486446b929fb5ac4b2b2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836ab2a5-a8b2-4431-9b16-065d6bc743fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836ab2a5-a8b2-4431-9b16-065d6bc743fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0654b224-a9be-412f-9b78-b74dae6c17f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0654b224-a9be-412f-9b78-b74dae6c17f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f43ad2-1719-4f70-99b1-ff2ecc5bf479', 'volume_name': 'volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77814d5-1132-4692-aa22-712ac10bbefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77814d5-1132-4692-aa22-712ac10bbefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d6dad4-5b29-420f-919e-39fcb138ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume 09f43ad2-1719-4f70-99b1-ff2ecc5bf479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479', 'volume_size': 1} Jul 09 01:27:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:07 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b 1073741824" returned: 0 in 0.943s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:07 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b Jul 09 01:27:07 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:08 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615812658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f43ad2-1719-4f70-99b1-ff2ecc5bf479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd04380efeb491b82c3c501e68145f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:27:07Z,use_quota=True,user_id='a17d6f28c486446b929fb5ac4b2b2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Creating volume 09f43ad2-1719-4f70-99b1-ff2ecc5bf479 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:27:08 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a547378-fa54-487f-8f72-b96610889679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac30bbdb-26af-4b79-a72d-5b280025833b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:08 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 1073741824 Jul 09 01:27:08 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d4acb3-2fa8-4047-95f2-413434628ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume volume-ac30bbdb-26af-4b79-a72d-5b280025833b (ac30bbdb-26af-4b79-a72d-5b280025833b): created successfully Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d4acb3-2fa8-4047-95f2-413434628ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Flow 'volume_create_manager' (7f904361-198c-4a1d-bf4f-7c867815b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8e3d006c-72a2-435d-b523-db92e0ff9eda tempest-TestServerVolumeAttachmentScenario-912333533 None] Created volume successfully. Jul 09 01:27:09 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 1073741824" returned: 0 in 0.896s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:09 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 Jul 09 01:27:09 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:09 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" returned: 0 in 0.696s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d6dad4-5b29-420f-919e-39fcb138ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc983b6-8f82-4e06-a3ec-b069639c19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d572725-e033-48d2-9613-e59ecee3571c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Volume volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 (09f43ad2-1719-4f70-99b1-ff2ecc5bf479): created successfully Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc983b6-8f82-4e06-a3ec-b069639c19c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:27:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Flow 'volume_create_manager' (91c711eb-846d-4918-98e8-4d7c52338c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:27:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-33aab00b-e435-4ed5-93e0-382a25017e40 tempest-TestServerVolumeAttachmentScenario-912333533 None] Created volume successfully. Jul 09 01:27:09 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 Jul 09 01:27:09 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:10 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-b49be809-30df-41a5-86a8-83f09ea84857', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff076df8-0616-4919-abf7-13628674512a', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:27:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-adad4dac-67f4-4b44-afad-c1c092597e30 req-bca29540-1e45-4d9f-9664-81aee3c655ef tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] attachment_update completed successfully. Jul 09 01:27:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-a78452bc-a74c-46a8-9e4b-59ec0977dd3c req-90471972-9222-4fa1-9626-dd296aacb839 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Terminate volume connection completed successfully. Jul 09 01:27:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-a78452bc-a74c-46a8-9e4b-59ec0977dd3c req-90471972-9222-4fa1-9626-dd296aacb839 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Deleting attachment ff076df8-0616-4919-abf7-13628674512a. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:27:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "cinder-b49be809-30df-41a5-86a8-83f09ea84857-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:27:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "cinder-b49be809-30df-41a5-86a8-83f09ea84857-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:27:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "cinder-quobyte-b49be809-30df-41a5-86a8-83f09ea84857" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:27:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "cinder-quobyte-b49be809-30df-41a5-86a8-83f09ea84857" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:27:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[31235fa7-6b2c-43b3-b1d2-bc60dea4399a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:27:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:20 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 Jul 09 01:27:20 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:21 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:21 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857 Jul 09 01:27:21 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:21 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b49be809-30df-41a5-86a8-83f09ea84857" returned: 0 in 0.684s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "cinder-quobyte-b49be809-30df-41a5-86a8-83f09ea84857" released by "delete_volume" :: held 1.654s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Created reservations ['44336b79-52aa-4dac-8d6e-2e831152ac00', '20e0be59-bf4a-4529-8be2-099f2a3a4d72', '55e83809-aa16-4c73-a2e5-482b82a5a624', 'd9ee22d0-1c57-4fa9-9183-35b14cdc8af8'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:21 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:27:21 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:22 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:22 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:27:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Deleted volume successfully. Jul 09 01:27:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb2c3d1c-1813-4ab2-b177-f4b5a13010c3 tempest-TestServerVolumeAttachScenarioOldVersion-1774852914 None] Lock "cinder-b49be809-30df-41a5-86a8-83f09ea84857-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:27:31 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=18,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:27:32 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:33 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:27:33 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:34 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.710s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:27:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:27:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:27:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:27:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:27:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:27:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b822316-3e14-4f80-a397-5022ab52a112]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:27:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:27:50 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b Jul 09 01:27:50 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:27:50 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 09 01:27:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:27:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:27:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-ac30bbdb-26af-4b79-a72d-5b280025833b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e07e2a0-33f1-47c2-bf1c-52f1c8278af1', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:27:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-512ae1dd-bb55-4349-be41-0e4a7121924e req-04273529-765d-4869-b5cf-54069be720ab tempest-TestServerVolumeAttachmentScenario-912333533 None] attachment_update completed successfully. Jul 09 01:28:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[579583ef-6bb3-4182-ad8f-24aee29fd482]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:00 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 Jul 09 01:28:00 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:01 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" returned: 0 in 0.863s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbdccaa4-3200-4d26-80d8-3d13a38053cc', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:28:01 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-4040f290-ca1f-4d81-b491-1a27fc93e492 req-83df6688-c5b7-4147-9651-5724519aa10c tempest-TestServerVolumeAttachmentScenario-912333533 None] attachment_update completed successfully. Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Flow 'volume_create_manager' (4b54e594-ef6e-442a-9123-bb65b71fb86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e36450-4118-4b7b-a42a-886492a64391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e36450-4118-4b7b-a42a-886492a64391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1541712500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb45d7e-2ec0-407a-937e-fe3700a92c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b086c47b778c439cb15b910aa2628f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:28:03Z,use_quota=True,user_id='90409b244d02455c95defc55312b9502',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c512a72-1ee3-4c4c-9dc6-af4fb0a6d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c512a72-1ee3-4c4c-9dc6-af4fb0a6d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d9fcdd-75a2-45ff-9df8-d655715a2a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d9fcdd-75a2-45ff-9df8-d655715a2a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb45d7e-2ec0-407a-937e-fe3700a92c4e', 'volume_name': 'volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23decc10-c5b1-4873-8176-f1c730582e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23decc10-c5b1-4873-8176-f1c730582e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d889a8-f972-48a6-be3b-b5c3a8694971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Volume 9eb45d7e-2ec0-407a-937e-fe3700a92c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e', 'volume_size': 1} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1541712500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb45d7e-2ec0-407a-937e-fe3700a92c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b086c47b778c439cb15b910aa2628f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:28:03Z,use_quota=True,user_id='90409b244d02455c95defc55312b9502',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Creating volume 9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:28:03 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:28:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:03 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e 1073741824 Jul 09 01:28:03 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:04 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e 1073741824" returned: 0 in 0.897s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:04 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:28:04 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:04 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.693s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d889a8-f972-48a6-be3b-b5c3a8694971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a321c32-1256-4757-aa14-942c856bd757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Volume volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e (9eb45d7e-2ec0-407a-937e-fe3700a92c4e): created successfully Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a321c32-1256-4757-aa14-942c856bd757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Flow 'volume_create_manager' (4b54e594-ef6e-442a-9123-bb65b71fb86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2777a833-1852-4f08-b11a-ff4d7dc17f26 tempest-TestStampPattern-1003079342 None] Created volume successfully. Jul 09 01:28:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-ceaa2ea3-a9c0-4077-a474-bb11bff77dc8 req-fdb61abe-cd8c-4e3e-aaae-5c0c4224a8e5 tempest-TestServerVolumeAttachmentScenario-912333533 None] Terminate volume connection completed successfully. Jul 09 01:28:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-ceaa2ea3-a9c0-4077-a474-bb11bff77dc8 req-fdb61abe-cd8c-4e3e-aaae-5c0c4224a8e5 tempest-TestServerVolumeAttachmentScenario-912333533 None] Deleting attachment cbdccaa4-3200-4d26-80d8-3d13a38053cc. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:28:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-d6a33802-03e7-40f8-a329-2f155ceddc20 req-749d185d-d029-4959-b321-715d7d417075 tempest-TestServerVolumeAttachmentScenario-912333533 None] Terminate volume connection completed successfully. Jul 09 01:28:10 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-d6a33802-03e7-40f8-a329-2f155ceddc20 req-749d185d-d029-4959-b321-715d7d417075 tempest-TestServerVolumeAttachmentScenario-912333533 None] Deleting attachment 2e07e2a0-33f1-47c2-bf1c-52f1c8278af1. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:28:17 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:28:20 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "cinder-09f43ad2-1719-4f70-99b1-ff2ecc5bf479-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-09f43ad2-1719-4f70-99b1-ff2ecc5bf479-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "cinder-quobyte-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-quobyte-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d882f76-5af0-4df0-a900-f9d49cf4054e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:21 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 Jul 09 01:28:21 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:22 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" returned: 0 in 0.782s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:22 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479 Jul 09 01:28:22 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:23 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" returned: 0 in 0.657s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-quobyte-09f43ad2-1719-4f70-99b1-ff2ecc5bf479" released by "delete_volume" :: held 1.501s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Created reservations ['32e2e35a-0125-4270-a3e4-e7e3997a8be6', '820900ae-ef6f-47e5-954d-8ea9cf32219a', '8337b737-a168-45a5-a3ca-2532aaa1e6dc', '2ce65bdd-83ac-4b27-9f56-d04caf4fc40a'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:23 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:28:23 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "cinder-ac30bbdb-26af-4b79-a72d-5b280025833b-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-ac30bbdb-26af-4b79-a72d-5b280025833b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "cinder-quobyte-ac30bbdb-26af-4b79-a72d-5b280025833b" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-quobyte-ac30bbdb-26af-4b79-a72d-5b280025833b" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c61f80-aacc-4f07-a545-f9bfc4949bf2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:24 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:24 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:28:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Deleted volume successfully. Jul 09 01:28:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-df399ac9-adf6-4e4b-b09b-3a721e60d551 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-09f43ad2-1719-4f70-99b1-ff2ecc5bf479-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:24 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b Jul 09 01:28:24 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:24 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b" returned: 0 in 0.813s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:24 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b Jul 09 01:28:24 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:25 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ac30bbdb-26af-4b79-a72d-5b280025833b" returned: 0 in 0.672s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-quobyte-ac30bbdb-26af-4b79-a72d-5b280025833b" released by "delete_volume" :: held 1.532s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Created reservations ['c2c5b98f-a338-41c6-93e3-950fcdd635c5', '09746195-6277-4e70-b94c-fadceb71b637', 'c8336dff-2cf5-467b-9d79-585450b85290', '7bcf62f6-9473-4de0-99eb-5b8da31deef7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:25 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:28:25 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:26 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.734s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:26 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:28:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Deleted volume successfully. Jul 09 01:28:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93619ed5-59cf-46a0-ab4f-d36adea444a8 tempest-TestServerVolumeAttachmentScenario-912333533 None] Lock "cinder-ac30bbdb-26af-4b79-a72d-5b280025833b-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:33 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:28:33 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:34 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.698s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:28:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:28:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:28:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:28:35 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=19,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Flow 'volume_create_manager' (f6cc8a2a-a13e-426c-b969-7070e2aab1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ddf9ad-7adb-417c-8ef4-17bb0d422372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ddf9ad-7adb-417c-8ef4-17bb0d422372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1104533600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b856528f-bc22-4b37-89f0-91b1800daeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6505aeeb3f490592d8eebc703538a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:28:36Z,use_quota=True,user_id='ef2c28c8ed5a4dc78db545f794edd1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da03c598-b4c5-4dd2-9176-62b40c6dbf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da03c598-b4c5-4dd2-9176-62b40c6dbf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a4a277-5830-4911-8e99-abd2aeebb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a4a277-5830-4911-8e99-abd2aeebb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b856528f-bc22-4b37-89f0-91b1800daeb6', 'volume_name': 'volume-b856528f-bc22-4b37-89f0-91b1800daeb6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7735922-88a5-42f0-9b41-6cd628352b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7735922-88a5-42f0-9b41-6cd628352b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97d5c4d-5131-4e98-bc1f-b57cf21f6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Volume b856528f-bc22-4b37-89f0-91b1800daeb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b856528f-bc22-4b37-89f0-91b1800daeb6', 'volume_size': 1} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1104533600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b856528f-bc22-4b37-89f0-91b1800daeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6505aeeb3f490592d8eebc703538a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:28:36Z,use_quota=True,user_id='ef2c28c8ed5a4dc78db545f794edd1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Creating volume b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:28:36 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:28:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:36 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 1073741824 Jul 09 01:28:36 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:37 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 1073741824" returned: 0 in 0.827s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:37 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:37 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:38 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97d5c4d-5131-4e98-bc1f-b57cf21f6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b856528f-bc22-4b37-89f0-91b1800daeb6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977d6d5-302b-4bbb-95bc-e2ca592056b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Volume volume-b856528f-bc22-4b37-89f0-91b1800daeb6 (b856528f-bc22-4b37-89f0-91b1800daeb6): created successfully Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977d6d5-302b-4bbb-95bc-e2ca592056b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Flow 'volume_create_manager' (f6cc8a2a-a13e-426c-b969-7070e2aab1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:38 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e7c6d14d-5157-4755-9f8c-73827ee81556 tempest-VolumeDependencyTests-333099380 None] Created volume successfully. Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Creating offline snapshot d4b59a38-d921-488b-a41c-381165b30a2e of volume b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0135d-88ab-4719-8f38-85bc68930577]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:38 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:38 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:39 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.760s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:39 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e 1G Jul 09 01:28:39 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:40 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e 1G" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b856528f-bc22-4b37-89f0-91b1800daeb6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:40 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b856528f-bc22-4b37-89f0-91b1800daeb6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:40 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:40 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b856528f-bc22-4b37-89f0-91b1800daeb6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.683s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:40 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e is being set with open permissions: ugo+rw Jul 09 01:28:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:40 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:40 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:41 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.643s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:41 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info Jul 09 01:28:41 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:42 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:42 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info is being set with open permissions: ugo+rw Jul 09 01:28:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:42 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info Jul 09 01:28:42 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:42 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.info" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e0ac28b7-7987-4c1c-9c86-57fdb11d59af tempest-VolumeDependencyTests-333099380 None] Create snapshot completed successfully Jul 09 01:28:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d3236-ef07-4615-b455-7eb5c13007ca]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:43 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:28:43 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:44 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.831s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96fdd724-b031-459c-b566-27dcc2ed97e5', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Flow 'volume_create_manager' (8c480724-dc86-416f-b7ae-871ae9e778ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95dd0e-0d60-4ba5-8c64-8919c57df7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95dd0e-0d60-4ba5-8c64-8919c57df7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-163972654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64e7712-4078-4d9e-8bde-2aa6cf636f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6505aeeb3f490592d8eebc703538a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d4b59a38-d921-488b-a41c-381165b30a2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:28:44Z,use_quota=True,user_id='ef2c28c8ed5a4dc78db545f794edd1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac8b72c-bf64-4cbe-bcf5-60d284a179fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac8b72c-bf64-4cbe-bcf5-60d284a179fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4a1f83-67b9-4808-b8be-cb734120dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4a1f83-67b9-4808-b8be-cb734120dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd64e7712-4078-4d9e-8bde-2aa6cf636f3e', 'volume_name': 'volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e', 'volume_size': 1, 'snapshot_id': 'd4b59a38-d921-488b-a41c-381165b30a2e'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4ea6eb-f896-4bba-a32d-e228f88ab4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4ea6eb-f896-4bba-a32d-e228f88ab4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bb801-7e41-4d28-8111-7fc5a30a248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Volume d64e7712-4078-4d9e-8bde-2aa6cf636f3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e', 'volume_size': 1, 'snapshot_id': 'd4b59a38-d921-488b-a41c-381165b30a2e'} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-4d1fe13b-1699-4e1a-8115-375dbe76e759 req-2b72aa5e-4da6-41d2-b0aa-e6645c890222 tempest-TestStampPattern-1003079342 None] attachment_update completed successfully. Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Creating volume d64e7712-4078-4d9e-8bde-2aa6cf636f3e from snapshot d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] snapshot: d4b59a38-d921-488b-a41c-381165b30a2e, volume: d64e7712-4078-4d9e-8bde-2aa6cf636f3e, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96646dd-5c8d-4845-9d9e-cfc86dd7bdd5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:44 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:44 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:45 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b856528f-bc22-4b37-89f0-91b1800daeb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6190f2e-5fbd-44bc-b6e0-2ef7ce38f98f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:45 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:45 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:46 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.813s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:46 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:28:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:46 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e Jul 09 01:28:46 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:51 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" returned: 0 in 4.901s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa51aca6-e7b3-4bec-94e6-8c685f3dc7d5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:51 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:51 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:52 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.971s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:28:52 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Converted 1024.00 MB image at 208.89 MB/s Jul 09 01:28:52 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e is being set with open permissions: ugo+rw Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:52 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e Jul 09 01:28:52 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:52 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" returned: 0 in 0.663s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" released by "_copy_volume_from_snapshot" :: held 8.252s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" released by "_create_volume_from_snapshot" :: held 8.281s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.302s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bb801-7e41-4d28-8111-7fc5a30a248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e', 'volume_size': 1, 'snapshot_id': 'd4b59a38-d921-488b-a41c-381165b30a2e'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7e05e7-d44e-4f34-aac3-7dcaede715fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:28:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Volume volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e (d64e7712-4078-4d9e-8bde-2aa6cf636f3e): created successfully Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7e05e7-d44e-4f34-aac3-7dcaede715fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:28:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Flow 'volume_create_manager' (8c480724-dc86-416f-b7ae-871ae9e778ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:28:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c6a67370-bdbb-4624-8764-fdf95f1f486e tempest-VolumeDependencyTests-333099380 None] Created volume successfully. Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-d4b59a38-d921-488b-a41c-381165b30a2e-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-d4b59a38-d921-488b-a41c-381165b30a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Deleting offline snapshot d4b59a38-d921-488b-a41c-381165b30a2e of volume b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] snapshot_file for this snap is: volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5590093-5b84-4e43-b8a7-5d2551070c8c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:53 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:53 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-e0db0463-e35f-4e0a-98f6-81074ab3fa14 req-98e91bec-f8ef-4785-b92a-c53ac6c2b7ed tempest-TestStampPattern-1003079342 None] Terminate volume connection completed successfully. Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-e0db0463-e35f-4e0a-98f6-81074ab3fa14 req-98e91bec-f8ef-4785-b92a-c53ac6c2b7ed tempest-TestStampPattern-1003079342 None] Deleting attachment 96fdd724-b031-459c-b566-27dcc2ed97e5. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:28:54 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.789s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b856528f-bc22-4b37-89f0-91b1800daeb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd391f51-608f-4e4e-b4ac-442d3da9e3d8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:54 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:54 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:54 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.785s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:54 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:54 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:55 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.723s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:55 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e Jul 09 01:28:55 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Creating offline snapshot bae9542d-f17c-4afb-82e7-393a6787aeb6 of volume 9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340b123-aa4b-471d-a0a5-c90eeb885e7a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:56 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6.d4b59a38-d921-488b-a41c-381165b30a2e" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:56 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:28:56 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d4b59a38-d921-488b-a41c-381165b30a2e" released by "_delete_snapshot" :: held 3.079s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" released by "delete_snapshot" :: held 3.100s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Created reservations ['82155a9c-0196-4332-b1b9-be2adc862889', '54666f32-b8f9-4231-a313-cc118e5386fd', '4d38ed55-c991-4739-b125-c7a84595782b', '888e1814-ff17-4144-bebe-b0cbbd291b3c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:28:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Delete snapshot completed successfully. Jul 09 01:28:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-061648c7-f215-4dcb-add3-d4b4d6464eee tempest-VolumeDependencyTests-333099380 None] Lock "cinder-d4b59a38-d921-488b-a41c-381165b30a2e-delete_snapshot" released by "delete_snapshot" :: held 3.242s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:57 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.777s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:57 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 1G Jul 09 01:28:57 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-b856528f-bc22-4b37-89f0-91b1800daeb6-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "cinder-b856528f-bc22-4b37-89f0-91b1800daeb6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a7811-ae27-4637-b2c5-6a39b1a9a112]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:57 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:57 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:57 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 1G" returned: 0 in 0.843s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:57 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:28:57 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:58 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.799s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:58 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6 Jul 09 01:28:58 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:58 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.694s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:58 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 is being set with open permissions: ugo+rw Jul 09 01:28:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:58 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:28:58 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:59 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b856528f-bc22-4b37-89f0-91b1800daeb6" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-b856528f-bc22-4b37-89f0-91b1800daeb6" released by "delete_volume" :: held 1.551s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Created reservations ['19868113-1787-4d73-a72f-453390bd4124', 'd41237f1-8ce8-4400-941b-4073bc760cd2', '23797d26-9d87-4495-a526-230443c3165b', '4007225d-6d53-41c1-aa7a-0f76baf28119'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:28:59 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.667s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:59 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:28:59 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:59 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info Jul 09 01:28:59 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-d64e7712-4078-4d9e-8bde-2aa6cf636f3e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "cinder-d64e7712-4078-4d9e-8bde-2aa6cf636f3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Acquiring lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a23d21-8a42-4cd9-913d-6260918c7046]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:28:59 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.681s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:28:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Deleted volume successfully. Jul 09 01:28:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd4555ad-c263-44f2-95b0-d6e69c319f2b tempest-VolumeDependencyTests-333099380 None] Lock "cinder-b856528f-bc22-4b37-89f0-91b1800daeb6-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:29:00 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:00 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info is being set with open permissions: ugo+rw Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:00 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e Jul 09 01:29:00 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:00 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info Jul 09 01:29:00 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:00 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.info" returned: 0 in 0.706s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.539s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:00 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" returned: 0 in 0.848s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:00 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e Jul 09 01:29:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2db0040d-dfaf-41ba-beff-925613860b68 tempest-TestStampPattern-1003079342 None] Create snapshot completed successfully Jul 09 01:29:00 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:01 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "cinder-quobyte-d64e7712-4078-4d9e-8bde-2aa6cf636f3e" released by "delete_volume" :: held 1.564s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Created reservations ['6cf91894-a098-481b-9c66-71f0ee02cd81', 'f2d01b9e-1120-4a3f-b40b-14a6362dc857', '8114b0f1-4d93-4725-9a3b-cb42dee36b59', '63319c59-eb14-41e9-a43d-5d5898462921'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:01 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:29:01 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:02 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.750s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:29:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Deleted volume successfully. Jul 09 01:29:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e95e6edf-adc4-428e-a31b-0961f5acc100 tempest-VolumeDependencyTests-333099380 None] Lock "cinder-d64e7712-4078-4d9e-8bde-2aa6cf636f3e-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Flow 'volume_create_manager' (c36ffacb-55b3-47cf-8273-2312cf028466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105909b-6a4d-4822-b6a4-5df1c55565f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d105909b-6a4d-4822-b6a4-5df1c55565f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1301616781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b7ab65-17e3-4ccf-bbba-c43315cf933f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b086c47b778c439cb15b910aa2628f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bae9542d-f17c-4afb-82e7-393a6787aeb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:29:11Z,use_quota=True,user_id='90409b244d02455c95defc55312b9502',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a430c25-292a-4f50-aab3-caede4252ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a430c25-292a-4f50-aab3-caede4252ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7baccac-9627-499f-be94-7d1c600e05e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7baccac-9627-499f-be94-7d1c600e05e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83b7ab65-17e3-4ccf-bbba-c43315cf933f', 'volume_name': 'volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f', 'volume_size': 1, 'snapshot_id': 'bae9542d-f17c-4afb-82e7-393a6787aeb6'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c450ea-b0c6-4dce-8973-9bcde044bb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c450ea-b0c6-4dce-8973-9bcde044bb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c659a1-f4ae-457c-a703-ab4008addd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:11 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Volume 83b7ab65-17e3-4ccf-bbba-c43315cf933f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f', 'volume_size': 1, 'snapshot_id': 'bae9542d-f17c-4afb-82e7-393a6787aeb6'} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6-83b7ab65-17e3-4ccf-bbba-c43315cf933f" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6-83b7ab65-17e3-4ccf-bbba-c43315cf933f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Creating volume 83b7ab65-17e3-4ccf-bbba-c43315cf933f from snapshot bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] snapshot: bae9542d-f17c-4afb-82e7-393a6787aeb6, volume: 83b7ab65-17e3-4ccf-bbba-c43315cf933f, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde3905-4d1d-4fd4-a598-4cf131aa2046]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:29:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:11 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:29:11 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:12 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e2720-b9bd-461a-8c32-95c2b7a09b56]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:29:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:12 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:29:12 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:13 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.755s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:13 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:29:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:13 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f Jul 09 01:29:13 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:18 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f" returned: 0 in 5.008s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f71920-91e8-4f60-a125-aea6f4fc574b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:29:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:18 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:29:18 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:19 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 1.076s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:19 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:29:19 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Converted 1024.00 MB image at 204.42 MB/s Jul 09 01:29:19 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f is being set with open permissions: ugo+rw Jul 09 01:29:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:19 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f Jul 09 01:29:19 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:20 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" released by "_copy_volume_from_snapshot" :: held 8.594s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6-83b7ab65-17e3-4ccf-bbba-c43315cf933f" released by "_create_volume_from_snapshot" :: held 8.636s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.655s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c659a1-f4ae-457c-a703-ab4008addd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f', 'volume_size': 1, 'snapshot_id': 'bae9542d-f17c-4afb-82e7-393a6787aeb6'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f527a67-2687-435d-a42b-ffac5d93912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:29:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Volume volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f (83b7ab65-17e3-4ccf-bbba-c43315cf933f): created successfully Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f527a67-2687-435d-a42b-ffac5d93912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:29:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Flow 'volume_create_manager' (c36ffacb-55b3-47cf-8273-2312cf028466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:29:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-561bb087-b58f-4035-b017-2cc376662bb5 tempest-TestStampPattern-1003079342 None] Created volume successfully. Jul 09 01:29:30 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=40,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:29:30 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=31,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:29:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:29:33 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:29:33 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:29:34 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 09 01:29:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:29:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:29:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:29:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:29:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a73c33-09c5-4c1a-b1de-7e91d36f4fe9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:08 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f Jul 09 01:30:08 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:08 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f" returned: 0 in 0.756s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10', 'name': 'volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3d41e66-d33f-4fce-b061-88a8b71eab0b', 'enforce_multipath': True} {{(pid=86954) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 01:30:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-a097f5b7-a203-4c48-b606-d7870f804df8 req-5d386796-571d-4229-8469-9ee4c29d1c7f tempest-TestStampPattern-1003079342 None] attachment_update completed successfully. Jul 09 01:30:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [req-ff0d4b62-37fb-488a-bcac-f84899f5d44b req-41754693-f184-4319-a32d-37c6d4cd555d tempest-TestStampPattern-1003079342 None] Terminate volume connection completed successfully. Jul 09 01:30:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [req-ff0d4b62-37fb-488a-bcac-f84899f5d44b req-41754693-f184-4319-a32d-37c6d4cd555d tempest-TestStampPattern-1003079342 None] Deleting attachment d3d41e66-d33f-4fce-b061-88a8b71eab0b. {{(pid=86954) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-83b7ab65-17e3-4ccf-bbba-c43315cf933f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "cinder-83b7ab65-17e3-4ccf-bbba-c43315cf933f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf86a5-88d4-4f64-91fe-41b6e8d87883]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:24 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f Jul 09 01:30:24 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:25 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:25 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f Jul 09 01:30:25 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:25 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-83b7ab65-17e3-4ccf-bbba-c43315cf933f" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-83b7ab65-17e3-4ccf-bbba-c43315cf933f" released by "delete_volume" :: held 1.483s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Created reservations ['fcbf301c-dd49-4d2e-a6ea-3e493f481ec9', '7385c21e-f0ba-4c28-9aac-1e62e3ace982', 'd33a2234-97d8-4c4d-acf3-1e046c737643', 'd413a53a-6f75-4b0b-97b6-879aca7c39fe'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:25 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:30:25 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:26 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:30:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Deleted volume successfully. Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-65bfc6f1-ff73-4809-a29f-61a222083d01 tempest-TestStampPattern-1003079342 None] Lock "cinder-83b7ab65-17e3-4ccf-bbba-c43315cf933f-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-bae9542d-f17c-4afb-82e7-393a6787aeb6-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-bae9542d-f17c-4afb-82e7-393a6787aeb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Deleting offline snapshot bae9542d-f17c-4afb-82e7-393a6787aeb6 of volume 9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] snapshot_file for this snap is: volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2a8ed-afae-4279-a516-c4bddfe16f62]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:26 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:30:26 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:27 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:30:27 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695e46d-9bef-4109-8a4e-ace1a26f979c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:27 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:30:27 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:28 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.729s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:28 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:30:28 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:28 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.720s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:28 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6 Jul 09 01:30:28 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:29 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e.bae9542d-f17c-4afb-82e7-393a6787aeb6" returned: 0 in 0.627s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-bae9542d-f17c-4afb-82e7-393a6787aeb6" released by "_delete_snapshot" :: held 2.910s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" released by "delete_snapshot" :: held 2.931s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:29 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Created reservations ['bf1f526b-253f-4b11-a16e-255e9535c192', '5a0aea19-ca12-4dae-98ba-b11ab562d6dd', '87f357cc-6354-41a3-82de-3864b52defb6', '5ad3c248-3601-42f5-a109-c1e7329131d0'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:30:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Delete snapshot completed successfully. Jul 09 01:30:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ae20c33b-6c4d-4bbd-9aa4-aa6c0a86a1c6 tempest-TestStampPattern-1003079342 None] Lock "cinder-bae9542d-f17c-4afb-82e7-393a6787aeb6-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:33 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:30:33 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:34 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.695s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:30:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:30:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:30:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-9eb45d7e-2ec0-407a-937e-fe3700a92c4e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "cinder-9eb45d7e-2ec0-407a-937e-fe3700a92c4e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Acquiring lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc743a6-16a0-4e33-a5be-0c415b41ee1a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:38 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:30:38 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:38 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:38 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e Jul 09 01:30:38 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:39 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" returned: 0 in 0.686s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "cinder-quobyte-9eb45d7e-2ec0-407a-937e-fe3700a92c4e" released by "delete_volume" :: held 1.474s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Created reservations ['eb9ac068-6362-4a34-bd8c-23161dc08513', '3e6cdade-0a1e-4b84-b0d4-109c0679c774', 'fd188728-98c2-41df-bc7a-fd9e55ca2af1', '4925a553-18f6-4b68-b115-0b09c4f6af55'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:39 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:30:39 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:40 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:40 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:30:40 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Deleted volume successfully. Jul 09 01:30:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e13a79f3-0a17-49b7-9955-a138881c506a tempest-TestStampPattern-1003079342 None] Lock "cinder-9eb45d7e-2ec0-407a-937e-fe3700a92c4e-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:30:49 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=17,cinder:UPDATE=27,cinder:INSERT=5 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:30:50 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=28,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Flow 'volume_create_manager' (c9febe1c-4a4f-4b13-9249-8cd178ca5862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17a72b7-f1ef-454f-b6d4-a9d8889460c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17a72b7-f1ef-454f-b6d4-a9d8889460c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56644da-0cc1-44a7-af34-344e89a78618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d342a0c0a34f8ba212310cbf34afc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:30:54Z,use_quota=True,user_id='f392cac1c212407f91d01b7e60d4e724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2de033f-500d-4c6f-adb5-dda4f3995907),volume_type_id=f2de033f-500d-4c6f-adb5-dda4f3995907)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9864ef16-50f4-47ba-ac81-01ddc18c1c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9864ef16-50f4-47ba-ac81-01ddc18c1c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1b31b1-1006-4e49-a681-d986e1495b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:30:53 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1b31b1-1006-4e49-a681-d986e1495b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a56644da-0cc1-44a7-af34-344e89a78618', 'volume_name': 'volume-a56644da-0cc1-44a7-af34-344e89a78618', 'volume_size': 1, 'image_id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e3b0ec2c05a18afcc1d272c7ca32853', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22d342a0c0a34f8ba212310cbf34afc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd16b252de943a1edac6458dd6aa6e3882124a363d858c84573a6b2c0e9736b57666a5859f5f7cf476a35693b4b1a845251e00287213f80edaa9b5beb0917c035', 'id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'created_at': datetime.datetime(2026, 7, 8, 23, 30, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f6cac2-50c8-4894-967f-e36bd538a11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e358ce-88b4-4712-9fb7-cc181ef08d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e358ce-88b4-4712-9fb7-cc181ef08d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d04bab-702b-4229-9449-5f3336888166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:30:54 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Volume a56644da-0cc1-44a7-af34-344e89a78618: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a56644da-0cc1-44a7-af34-344e89a78618', 'volume_size': 1, 'image_id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e3b0ec2c05a18afcc1d272c7ca32853', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22d342a0c0a34f8ba212310cbf34afc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd16b252de943a1edac6458dd6aa6e3882124a363d858c84573a6b2c0e9736b57666a5859f5f7cf476a35693b4b1a845251e00287213f80edaa9b5beb0917c035', 'id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'created_at': datetime.datetime(2026, 7, 8, 23, 30, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f6cac2-50c8-4894-967f-e36bd538a11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Trying to clone a56644da-0cc1-44a7-af34-344e89a78618 from image b9f6cac2-50c8-4894-967f-e36bd538a11e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:30:54 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Image download 0.00 MB at 0.00 MB/s Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2539cea-d102-4b4c-8ab5-30b8d38d16cf]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:54 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:30:54 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:55 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:55 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:30:55 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:55 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 1 in 0.708s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Temporary image b9f6cac2-50c8-4894-967f-e36bd538a11e is fetched for user f392cac1c212407f91d01b7e60d4e724. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f66a83a-64fa-4d07-b320-df02bf67e376]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:56 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:30:56 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:56 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:56 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:30:56 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:57 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 1 in 0.754s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56644da-0cc1-44a7-af34-344e89a78618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d342a0c0a34f8ba212310cbf34afc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:30:54Z,use_quota=True,user_id='f392cac1c212407f91d01b7e60d4e724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2de033f-500d-4c6f-adb5-dda4f3995907),volume_type_id=f2de033f-500d-4c6f-adb5-dda4f3995907)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Creating volume a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:30:57 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:30:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:57 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1073741824 Jul 09 01:30:57 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:58 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1073741824" returned: 0 in 0.817s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:58 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:30:58 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:58 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 0 in 0.631s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Attempting download of b9f6cac2-50c8-4894-967f-e36bd538a11e ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}])) to volume a56644da-0cc1-44a7-af34-344e89a78618. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[971381ea-a7ed-49d4-b7e7-dcbf7c4ff9ce]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:30:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:59 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67 Jul 09 01:30:59 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:30:59 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 09 01:30:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67" returned: 0 in 0.714s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:30:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:30:59 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67 Jul 09 01:30:59 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:00 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67" returned: 1 in 0.712s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f6cac2-50c8-4894-967f-e36bd538a11e_okdkcn67' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:31:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08122c09-6266-49fa-b629-73aa9c1186f3]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:00 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:31:00 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:01 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:01 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD Jul 09 01:31:01 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:01 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD" returned: 1 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] b9f6cac2-50c8-4894-967f-e36bd538a11e was raw, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:31:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:01 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:01 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:02 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 0 in 0.714s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:02 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f6cac2-50c8-4894-967f-e36bd538a11e_4aljt590devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:31:02 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 01:31:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:02 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1G Jul 09 01:31:02 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:03 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 1G" returned: 0 in 0.702s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4293fc9-7bc7-44cb-b300-9a9239713310]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:03 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:03 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:04 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:04 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:04 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:04 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 1 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Downloaded image b9f6cac2-50c8-4894-967f-e36bd538a11e ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}])) to volume a56644da-0cc1-44a7-af34-344e89a78618 successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Temporary image b9f6cac2-50c8-4894-967f-e36bd538a11e for user f392cac1c212407f91d01b7e60d4e724 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Marking volume a56644da-0cc1-44a7-af34-344e89a78618 as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Copying metadata from image b9f6cac2-50c8-4894-967f-e36bd538a11e to a56644da-0cc1-44a7-af34-344e89a78618. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Creating volume glance metadata for volume a56644da-0cc1-44a7-af34-344e89a78618 backed by image b9f6cac2-50c8-4894-967f-e36bd538a11e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3e3b0ec2c05a18afcc1d272c7ca32853', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d04bab-702b-4229-9449-5f3336888166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56644da-0cc1-44a7-af34-344e89a78618', 'volume_size': 1, 'image_id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f6cac2-50c8-4894-967f-e36bd538a11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e3b0ec2c05a18afcc1d272c7ca32853', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22d342a0c0a34f8ba212310cbf34afc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd16b252de943a1edac6458dd6aa6e3882124a363d858c84573a6b2c0e9736b57666a5859f5f7cf476a35693b4b1a845251e00287213f80edaa9b5beb0917c035', 'id': 'b9f6cac2-50c8-4894-967f-e36bd538a11e', 'created_at': datetime.datetime(2026, 7, 8, 23, 30, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f6cac2-50c8-4894-967f-e36bd538a11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285fc165-7a8a-4d8b-861a-4d3c9acee2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Volume volume-a56644da-0cc1-44a7-af34-344e89a78618 (a56644da-0cc1-44a7-af34-344e89a78618): created successfully Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285fc165-7a8a-4d8b-861a-4d3c9acee2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Flow 'volume_create_manager' (c9febe1c-4a4f-4b13-9249-8cd178ca5862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e2ffadb9-60de-46b7-be86-d7a0888125ba tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Created volume successfully. Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Acquiring lock "cinder-a56644da-0cc1-44a7-af34-344e89a78618-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "cinder-a56644da-0cc1-44a7-af34-344e89a78618-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Acquiring lock "cinder-quobyte-a56644da-0cc1-44a7-af34-344e89a78618" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "cinder-quobyte-a56644da-0cc1-44a7-af34-344e89a78618" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2bfcd-5952-4145-b93f-39862413d2b0]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:05 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:05 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:06 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 0 in 0.727s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:06 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:06 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:07 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 1 in 0.735s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:07 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618 Jul 09 01:31:07 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:07 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a56644da-0cc1-44a7-af34-344e89a78618" returned: 0 in 0.674s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "cinder-quobyte-a56644da-0cc1-44a7-af34-344e89a78618" released by "delete_volume" :: held 2.196s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:07 devstack cinder-volume[86954]: WARNING cinder.quota [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:31:07 devstack cinder-volume[86954]: WARNING cinder.quota [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Created reservations ['45f7af17-b713-4b69-ace0-167da4e7797a', 'f4637156-fc89-4074-a9d1-c5117ab20210', 'f9582b99-f023-4ad4-93a9-8184cf587f15', '9ed0513e-f161-488f-bfe1-5c4771718175'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:07 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:07 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:08 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.645s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:08 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Deleted volume successfully. Jul 09 01:31:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-681c6dd0-ec73-4aed-b5f4-f6ebc3c9cc35 tempest-VolumeAndVolumeTypeFromImageTest-1473840089 None] Lock "cinder-a56644da-0cc1-44a7-af34-344e89a78618-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (95b3d2d5-ef7e-4fde-8ff6-0e9a1b6b312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa79be4-77c8-478d-a293-4d4edab0b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa79be4-77c8-478d-a293-4d4edab0b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797191440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd835c7-a883-49b7-abb9-a5e8fdcbafae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:13Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caca8a2a-59eb-41f9-a7a7-31e663a41cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caca8a2a-59eb-41f9-a7a7-31e663a41cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9e9af3-19e4-48d0-9d05-484bb8df9f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9e9af3-19e4-48d0-9d05-484bb8df9f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd835c7-a883-49b7-abb9-a5e8fdcbafae', 'volume_name': 'volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cafbd70-c630-4e4f-8973-d3321fef93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cafbd70-c630-4e4f-8973-d3321fef93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cc97aa-12da-4746-b746-b5e9e3b12557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Volume bdd835c7-a883-49b7-abb9-a5e8fdcbafae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae', 'volume_size': 1} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797191440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd835c7-a883-49b7-abb9-a5e8fdcbafae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:13Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Creating volume bdd835c7-a883-49b7-abb9-a5e8fdcbafae {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:13 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:13 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae 1073741824 Jul 09 01:31:13 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (c780e630-e607-4aeb-993c-6351ea4db959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eacbade-a9d6-4e74-a20f-f4f5ca20ecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eacbade-a9d6-4e74-a20f-f4f5ca20ecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984600103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655bcc2-b95c-455f-a142-93f9929f6bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:13Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392a3462-0099-4af0-a646-d047bffb0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392a3462-0099-4af0-a646-d047bffb0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62707d15-17cc-4ea7-ac99-95176665f0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62707d15-17cc-4ea7-ac99-95176665f0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5655bcc2-b95c-455f-a142-93f9929f6bd6', 'volume_name': 'volume-5655bcc2-b95c-455f-a142-93f9929f6bd6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb88dc1-6096-4654-89df-a012f7d818e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb88dc1-6096-4654-89df-a012f7d818e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2edde-9af9-42f5-b5df-9f2d81f6a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Volume 5655bcc2-b95c-455f-a142-93f9929f6bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5655bcc2-b95c-455f-a142-93f9929f6bd6', 'volume_size': 1} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (4a95233a-a906-4448-ba2e-5530c0a473c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450c42f9-9f2f-4dcc-a502-8e5cb88a122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450c42f9-9f2f-4dcc-a502-8e5cb88a122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589587899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fbf7f5-2fb8-4f96-a78c-73f963da4246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:14Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb37bb3b-f32f-42a6-8772-4d9ac2b0028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb37bb3b-f32f-42a6-8772-4d9ac2b0028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431a315c-28d1-4d07-92d1-fd5f1e059ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431a315c-28d1-4d07-92d1-fd5f1e059ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fbf7f5-2fb8-4f96-a78c-73f963da4246', 'volume_name': 'volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a24669-b7fd-4696-8b9a-7c049adb7a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a24669-b7fd-4696-8b9a-7c049adb7a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b998d60-286f-4423-ad14-88230ba29742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Volume 01fbf7f5-2fb8-4f96-a78c-73f963da4246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246', 'volume_size': 1} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:13 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae 1073741824" returned: 0 in 0.902s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:13 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae Jul 09 01:31:13 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (03c78a80-45e5-4d26-92f7-f91f09b006c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f91149-4c4b-45ee-a3a2-d5bbf0128edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f91149-4c4b-45ee-a3a2-d5bbf0128edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623479919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bd0763-e8d6-435b-8b01-768f28bdd1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:14Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52af2af0-008f-4220-91a0-ae59bab9b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52af2af0-008f-4220-91a0-ae59bab9b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d69cba1-9bfb-44b5-aa35-a6a563859932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d69cba1-9bfb-44b5-aa35-a6a563859932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bd0763-e8d6-435b-8b01-768f28bdd1bb', 'volume_name': 'volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4687a6-194b-4d39-b4c8-147a7c46a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4687a6-194b-4d39-b4c8-147a7c46a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc8c172-84b3-4ba9-a4a5-c86c2b9dba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Volume 78bd0763-e8d6-435b-8b01-768f28bdd1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb', 'volume_size': 1} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:14 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984600103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655bcc2-b95c-455f-a142-93f9929f6bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:13Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Creating volume 5655bcc2-b95c-455f-a142-93f9929f6bd6 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:14 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:14 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 1073741824 Jul 09 01:31:14 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cc97aa-12da-4746-b746-b5e9e3b12557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716d9be3-9006-43f0-8d52-4ad8035df4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (fe2ae0c2-b70f-4439-a319-eddb59ebc5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f232aa0b-6063-4ac2-a399-1571e67edff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Volume volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae (bdd835c7-a883-49b7-abb9-a5e8fdcbafae): created successfully Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716d9be3-9006-43f0-8d52-4ad8035df4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (95b3d2d5-ef7e-4fde-8ff6-0e9a1b6b312c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f232aa0b-6063-4ac2-a399-1571e67edff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916051444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b059283-539e-4d7a-b245-f8517f4987c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:15Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180d04a3-6470-4e8c-8918-bf9d2b087838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180d04a3-6470-4e8c-8918-bf9d2b087838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a4bfa8-58b5-44af-a772-05c462e68428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a4bfa8-58b5-44af-a772-05c462e68428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b059283-539e-4d7a-b245-f8517f4987c4', 'volume_name': 'volume-2b059283-539e-4d7a-b245-f8517f4987c4', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9cf59-9f7b-439e-b781-e43263916cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9cf59-9f7b-439e-b781-e43263916cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9df3020-bac9-4476-ae91-69de5402c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Volume 2b059283-539e-4d7a-b245-f8517f4987c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b059283-539e-4d7a-b245-f8517f4987c4', 'volume_size': 1} Jul 09 01:31:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-69c81761-e856-4afc-8f09-3023f9daaa02 tempest-CreateVolumesFromImageTest-1400168952 None] Created volume successfully. Jul 09 01:31:15 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 1073741824" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:15 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 Jul 09 01:31:15 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:16 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6" returned: 0 in 0.635s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.392s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589587899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fbf7f5-2fb8-4f96-a78c-73f963da4246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:14Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Creating volume 01fbf7f5-2fb8-4f96-a78c-73f963da4246 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:16 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:16 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 1073741824 Jul 09 01:31:16 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2edde-9af9-42f5-b5df-9f2d81f6a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5655bcc2-b95c-455f-a142-93f9929f6bd6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c228ce2-762b-48b6-991f-5d201c83cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:16 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Volume volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 (5655bcc2-b95c-455f-a142-93f9929f6bd6): created successfully Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c228ce2-762b-48b6-991f-5d201c83cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (c780e630-e607-4aeb-993c-6351ea4db959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-692cd855-5367-48b0-9bde-d458375fb904 tempest-CreateVolumesFromImageTest-1400168952 None] Created volume successfully. Jul 09 01:31:16 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 1073741824" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:16 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 Jul 09 01:31:16 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:17 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.255s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623479919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bd0763-e8d6-435b-8b01-768f28bdd1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:14Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Creating volume 78bd0763-e8d6-435b-8b01-768f28bdd1bb {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:17 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb 1073741824 Jul 09 01:31:17 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b998d60-286f-4423-ad14-88230ba29742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46207d6-caac-42bd-ac82-2bc4e8798979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:17 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Volume volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 (01fbf7f5-2fb8-4f96-a78c-73f963da4246): created successfully Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46207d6-caac-42bd-ac82-2bc4e8798979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (4a95233a-a906-4448-ba2e-5530c0a473c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-70eb7aba-99da-4c4c-a8c1-c01f96d46868 tempest-CreateVolumesFromImageTest-1400168952 None] Created volume successfully. Jul 09 01:31:18 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb 1073741824" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:18 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb Jul 09 01:31:18 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:19 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb" returned: 0 in 0.636s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.365s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1916051444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b059283-539e-4d7a-b245-f8517f4987c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bd107164074d9793ce4f5823c80bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:15Z,use_quota=True,user_id='522da6dc193f43e983878fa62ec218d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Creating volume 2b059283-539e-4d7a-b245-f8517f4987c4 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:19 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc8c172-84b3-4ba9-a4a5-c86c2b9dba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:19 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 1073741824 Jul 09 01:31:19 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25aad35d-d3e9-41df-ad83-957ca3692ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Volume volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb (78bd0763-e8d6-435b-8b01-768f28bdd1bb): created successfully Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25aad35d-d3e9-41df-ad83-957ca3692ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (03c78a80-45e5-4d26-92f7-f91f09b006c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c17387b2-adeb-4c97-9132-1612ba9a0af3 tempest-CreateVolumesFromImageTest-1400168952 None] Created volume successfully. Jul 09 01:31:19 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 1073741824" returned: 0 in 0.824s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:20 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 Jul 09 01:31:20 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:20 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4" returned: 0 in 0.645s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9df3020-bac9-4476-ae91-69de5402c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b059283-539e-4d7a-b245-f8517f4987c4', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2ba632-5438-4b6b-a851-ebce181b8a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Volume volume-2b059283-539e-4d7a-b245-f8517f4987c4 (2b059283-539e-4d7a-b245-f8517f4987c4): created successfully Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2ba632-5438-4b6b-a851-ebce181b8a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Flow 'volume_create_manager' (fe2ae0c2-b70f-4439-a319-eddb59ebc5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ee474b7a-d001-4c3b-8ab1-2d89cdeddc05 tempest-CreateVolumesFromImageTest-1400168952 None] Created volume successfully. Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-2b059283-539e-4d7a-b245-f8517f4987c4-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-2b059283-539e-4d7a-b245-f8517f4987c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-quobyte-2b059283-539e-4d7a-b245-f8517f4987c4" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-2b059283-539e-4d7a-b245-f8517f4987c4" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2e4e3-4842-4e5e-8cb3-3d3221e5db5c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:21 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 Jul 09 01:31:21 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:22 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4" returned: 0 in 0.749s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:22 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4 Jul 09 01:31:22 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:22 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-2b059283-539e-4d7a-b245-f8517f4987c4" returned: 0 in 0.653s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-2b059283-539e-4d7a-b245-f8517f4987c4" released by "delete_volume" :: held 1.440s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Created reservations ['a59101c2-6dac-4124-b175-99f9e7507c8e', 'e73d3377-2b6d-4875-a2bc-0357c008fed7', '076a399d-7e69-4f45-857f-7e62b44d4858', 'ee831a87-7be9-44de-8e0e-070a102a7620'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:22 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:22 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-78bd0763-e8d6-435b-8b01-768f28bdd1bb-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-78bd0763-e8d6-435b-8b01-768f28bdd1bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:23 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-quobyte-78bd0763-e8d6-435b-8b01-768f28bdd1bb" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.675s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Deleted volume successfully. Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-78bd0763-e8d6-435b-8b01-768f28bdd1bb" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e2865228-62d3-4685-928a-80efed5cdbaa tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-2b059283-539e-4d7a-b245-f8517f4987c4-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb276c-e464-4205-a57c-817adafd5b8a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:23 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb Jul 09 01:31:23 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:24 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb" returned: 0 in 0.752s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:24 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb Jul 09 01:31:24 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:24 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-78bd0763-e8d6-435b-8b01-768f28bdd1bb" returned: 0 in 0.632s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-78bd0763-e8d6-435b-8b01-768f28bdd1bb" released by "delete_volume" :: held 1.427s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Created reservations ['77092e59-4756-4b6f-8827-15e960417b44', 'd36fcabb-418d-4d1d-a7b2-1bcf44ed4d3f', 'a715ab68-e5e8-4949-9a9e-a034b8051678', '62d960f3-291e-4e6b-924e-210e29c7bfb7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:25 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:25 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-01fbf7f5-2fb8-4f96-a78c-73f963da4246-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-01fbf7f5-2fb8-4f96-a78c-73f963da4246-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-quobyte-01fbf7f5-2fb8-4f96-a78c-73f963da4246" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:25 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.674s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:25 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Deleted volume successfully. Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-01fbf7f5-2fb8-4f96-a78c-73f963da4246" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d39ae20d-3e00-4baa-9bce-cbefd9397b97 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-78bd0763-e8d6-435b-8b01-768f28bdd1bb-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd035c-6a0e-4d9c-b9f0-5b90261161d8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:25 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 Jul 09 01:31:25 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:26 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246" returned: 0 in 0.760s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:26 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246 Jul 09 01:31:26 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:27 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-01fbf7f5-2fb8-4f96-a78c-73f963da4246" returned: 0 in 0.644s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-01fbf7f5-2fb8-4f96-a78c-73f963da4246" released by "delete_volume" :: held 1.447s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Created reservations ['6e8a4109-45e7-42d8-85a9-6e799e99b785', '64c111a8-fd6f-456d-90dd-00a4a646f169', 'd654d54f-b8ae-4b75-80e6-a6e0682f04d1', '649aeb55-5c44-4e97-b706-6ebe97bd02dc'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:27 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:27 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-5655bcc2-b95c-455f-a142-93f9929f6bd6-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-5655bcc2-b95c-455f-a142-93f9929f6bd6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-quobyte-5655bcc2-b95c-455f-a142-93f9929f6bd6" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:27 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.673s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Deleted volume successfully. Jul 09 01:31:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-5655bcc2-b95c-455f-a142-93f9929f6bd6" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9a395-e53e-45b4-845e-4e9645b55fd5]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-68a0c770-f878-421d-9912-c59f672723b9 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-01fbf7f5-2fb8-4f96-a78c-73f963da4246-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:28 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 Jul 09 01:31:28 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:28 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:28 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6 Jul 09 01:31:28 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:29 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5655bcc2-b95c-455f-a142-93f9929f6bd6" returned: 0 in 0.646s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-5655bcc2-b95c-455f-a142-93f9929f6bd6" released by "delete_volume" :: held 1.429s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Created reservations ['22c239c9-c440-46a1-bd8a-7748629a4400', '9e65f2a3-6504-4b80-a223-cec2e5e71c78', '538a4582-fb59-4179-85db-7db3b5010827', '42a35e67-9b5d-41fd-ac59-a05166ca348c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:29 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:29 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-bdd835c7-a883-49b7-abb9-a5e8fdcbafae-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:30 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-bdd835c7-a883-49b7-abb9-a5e8fdcbafae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Deleted volume successfully. Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0e3ff343-8ca5-4315-84f8-e02ebfec8b9e tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-5655bcc2-b95c-455f-a142-93f9929f6bd6-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "cinder-quobyte-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" acquired by "delete_volume" :: waited 0.012s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b695088-686b-4dce-9272-4b863c4451fe]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:30 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae Jul 09 01:31:30 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:31 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" returned: 0 in 0.767s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:31 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae Jul 09 01:31:31 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:31 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" returned: 0 in 0.701s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-quobyte-bdd835c7-a883-49b7-abb9-a5e8fdcbafae" released by "delete_volume" :: held 1.509s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Created reservations ['97ed7943-deab-4d17-af90-28b8a094a5d9', '92b6dade-223d-443a-b86f-9efa2690e0eb', '1b20c9a5-eff1-417b-a1c9-66ba9513f0ca', '3aabeadf-c651-4efd-a385-5711473a09b2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:31 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:31 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:32 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:32 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Deleted volume successfully. Jul 09 01:31:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-98050165-5e6f-4581-b850-342d1c818997 tempest-CreateVolumesFromImageTest-1400168952 None] Lock "cinder-bdd835c7-a883-49b7-abb9-a5e8fdcbafae-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:33 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:33 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:34 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.691s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:31:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:31:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (5178cafc-b181-43ad-9d9f-1530f487e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6eaf5d-7488-434f-93dc-81e9c18b49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6eaf5d-7488-434f-93dc-81e9c18b49b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288595643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b07fe9-e926-4e5c-838d-eba0a17d92f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:35Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92bc21bc-677d-4514-9a51-02f2f4f7812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92bc21bc-677d-4514-9a51-02f2f4f7812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6103c-fc0b-448a-9cda-a45d42513adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6103c-fc0b-448a-9cda-a45d42513adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b07fe9-e926-4e5c-838d-eba0a17d92f1', 'volume_name': 'volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ed0ba4-a224-46c2-83cd-61ed9c7f0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ed0ba4-a224-46c2-83cd-61ed9c7f0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ca1ba-a12d-4307-b77a-c31b2f987bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume d7b07fe9-e926-4e5c-838d-eba0a17d92f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1', 'volume_size': 1} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288595643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b07fe9-e926-4e5c-838d-eba0a17d92f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:35Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume d7b07fe9-e926-4e5c-838d-eba0a17d92f1 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:35 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:35 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 1073741824 Jul 09 01:31:35 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:36 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 1073741824" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:36 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 Jul 09 01:31:36 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:36 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" returned: 0 in 0.656s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ca1ba-a12d-4307-b77a-c31b2f987bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5dc175-0732-4a3d-b706-3de9d5e2bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:36 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 (d7b07fe9-e926-4e5c-838d-eba0a17d92f1): created successfully Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5dc175-0732-4a3d-b706-3de9d5e2bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:36 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (5178cafc-b181-43ad-9d9f-1530f487e127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-aa68fa33-594c-4e3c-8fd2-d2df804feded tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (5e2970a0-860e-4273-b9e9-ca0bb877f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7282f92-8096-4a91-bcff-6ae53213610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7282f92-8096-4a91-bcff-6ae53213610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386043865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f845a1a5-9c75-42c5-be9f-48433242a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:38Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1f7ff5-e8e0-4f39-852a-98b70f907649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1f7ff5-e8e0-4f39-852a-98b70f907649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84efe4a5-fb36-4d93-872a-a10b5c176437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84efe4a5-fb36-4d93-872a-a10b5c176437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f845a1a5-9c75-42c5-be9f-48433242a2df', 'volume_name': 'volume-f845a1a5-9c75-42c5-be9f-48433242a2df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6673a6b-6434-47cf-8fcb-202510062efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6673a6b-6434-47cf-8fcb-202510062efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9327c9-ece3-47ad-863e-1a970c7dd31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume f845a1a5-9c75-42c5-be9f-48433242a2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f845a1a5-9c75-42c5-be9f-48433242a2df', 'volume_size': 1} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386043865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f845a1a5-9c75-42c5-be9f-48433242a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:38Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume f845a1a5-9c75-42c5-be9f-48433242a2df {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:37 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:37 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df 1073741824 Jul 09 01:31:37 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (fbb5ce41-cf2b-4f82-95b9-2a96c4ad6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b510de9-2645-420c-bbf7-2ce617b20b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b510de9-2645-420c-bbf7-2ce617b20b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085028506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d85467f-6a8c-4996-86fa-3a9834ee6606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:38Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b66d3e7-ef4a-45a9-9838-e488d02fd4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b66d3e7-ef4a-45a9-9838-e488d02fd4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9900b58d-5067-4742-885a-015df8579b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9900b58d-5067-4742-885a-015df8579b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d85467f-6a8c-4996-86fa-3a9834ee6606', 'volume_name': 'volume-1d85467f-6a8c-4996-86fa-3a9834ee6606', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ee5473-2d8e-41d7-9387-e044c01fdb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ee5473-2d8e-41d7-9387-e044c01fdb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b55117b-9f04-41a5-981e-f8bb56bd0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume 1d85467f-6a8c-4996-86fa-3a9834ee6606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d85467f-6a8c-4996-86fa-3a9834ee6606', 'volume_size': 1} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (51187a61-f30a-4309-aa6a-e45bb3e92fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93785b8e-c79a-4ede-89b2-de4b286e1371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93785b8e-c79a-4ede-89b2-de4b286e1371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741916888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ded01e-948f-41e5-8f61-23dd8f12e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e758b609-a039-4ad7-a7be-ca31db465983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e758b609-a039-4ad7-a7be-ca31db465983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6657ff-04e4-4f48-b964-e04307160cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6657ff-04e4-4f48-b964-e04307160cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ded01e-948f-41e5-8f61-23dd8f12e062', 'volume_name': 'volume-f5ded01e-948f-41e5-8f61-23dd8f12e062', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d174110-6ad0-4240-98d6-42728e953a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d174110-6ad0-4240-98d6-42728e953a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da34a57e-bfb8-4508-a4ec-a9fa5fef2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume f5ded01e-948f-41e5-8f61-23dd8f12e062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ded01e-948f-41e5-8f61-23dd8f12e062', 'volume_size': 1} Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:38 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df 1073741824" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (055c811f-5ca0-465e-ac1a-28a2c64539dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c94722-e76b-475a-baaa-8f28fbcb6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c94722-e76b-475a-baaa-8f28fbcb6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1156950731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6165c0-d585-4b16-91e7-9687ec524252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078d06bd-1241-496d-8884-d6b947f2e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078d06bd-1241-496d-8884-d6b947f2e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb3209-63cc-49a3-b060-c74c45b8ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb3209-63cc-49a3-b060-c74c45b8ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6165c0-d585-4b16-91e7-9687ec524252', 'volume_name': 'volume-9f6165c0-d585-4b16-91e7-9687ec524252', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a28736-1044-46e5-9f3b-7139fa1f59ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a28736-1044-46e5-9f3b-7139fa1f59ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e433ed-2f60-4fcb-bbfe-2bf02f192671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume 9f6165c0-d585-4b16-91e7-9687ec524252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6165c0-d585-4b16-91e7-9687ec524252', 'volume_size': 1} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:39 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df Jul 09 01:31:39 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (69024aee-c0ce-4069-a017-3fefa13d2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb9a606-2bce-4227-aeb3-6dfaa33d9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb9a606-2bce-4227-aeb3-6dfaa33d9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275940831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c21930-4a84-4807-a526-5d068aa0995c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067b9cf6-7a32-4d94-97af-064a740fc3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067b9cf6-7a32-4d94-97af-064a740fc3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8c5046-2a3c-4f58-898c-307eef434868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8c5046-2a3c-4f58-898c-307eef434868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c21930-4a84-4807-a526-5d068aa0995c', 'volume_name': 'volume-07c21930-4a84-4807-a526-5d068aa0995c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b00757-3613-4247-9fad-6e51247d08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b00757-3613-4247-9fad-6e51247d08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731cf88c-abdb-4988-8f96-ae5db30907a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume 07c21930-4a84-4807-a526-5d068aa0995c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c21930-4a84-4807-a526-5d068aa0995c', 'volume_size': 1} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:39 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085028506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d85467f-6a8c-4996-86fa-3a9834ee6606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:38Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume 1d85467f-6a8c-4996-86fa-3a9834ee6606 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:39 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:39 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 1073741824 Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9327c9-ece3-47ad-863e-1a970c7dd31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f845a1a5-9c75-42c5-be9f-48433242a2df', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83517f2-7789-4720-afa9-51f5d51bc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-f845a1a5-9c75-42c5-be9f-48433242a2df (f845a1a5-9c75-42c5-be9f-48433242a2df): created successfully Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83517f2-7789-4720-afa9-51f5d51bc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (5e2970a0-860e-4273-b9e9-ca0bb877f222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b18bf16c-ac0a-45d0-8936-1ba28717926f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:40 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 1073741824" returned: 0 in 0.919s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:40 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 Jul 09 01:31:40 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:41 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606" returned: 0 in 0.666s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.785s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741916888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ded01e-948f-41e5-8f61-23dd8f12e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume f5ded01e-948f-41e5-8f61-23dd8f12e062 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:41 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:41 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 1073741824 Jul 09 01:31:41 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b55117b-9f04-41a5-981e-f8bb56bd0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d85467f-6a8c-4996-86fa-3a9834ee6606', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2684ed49-2074-40c3-b344-a0fba9d15c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 (1d85467f-6a8c-4996-86fa-3a9834ee6606): created successfully Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2684ed49-2074-40c3-b344-a0fba9d15c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (fbb5ce41-cf2b-4f82-95b9-2a96c4ad6192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-dce6f643-0062-4e2f-a3fa-d24dbd447144 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:42 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 1073741824" returned: 0 in 0.868s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:42 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 Jul 09 01:31:42 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:43 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062" returned: 0 in 0.699s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.940s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1156950731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6165c0-d585-4b16-91e7-9687ec524252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume 9f6165c0-d585-4b16-91e7-9687ec524252 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:43 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:43 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 1073741824 Jul 09 01:31:43 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da34a57e-bfb8-4508-a4ec-a9fa5fef2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ded01e-948f-41e5-8f61-23dd8f12e062', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f67a1f-459d-4934-bd0f-127c4b1bb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 (f5ded01e-948f-41e5-8f61-23dd8f12e062): created successfully Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f67a1f-459d-4934-bd0f-127c4b1bb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (51187a61-f30a-4309-aa6a-e45bb3e92fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a365de2b-49fe-417a-8a67-646cb9ada36f tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:43 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 1073741824" returned: 0 in 0.871s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:44 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 Jul 09 01:31:44 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:44 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252" returned: 0 in 0.642s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.176s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275940831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c21930-4a84-4807-a526-5d068aa0995c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee99390d9b54a4490fab88d6d3c21df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:31:39Z,use_quota=True,user_id='9fcf69d5dc0e47c581664945ae209056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Creating volume 07c21930-4a84-4807-a526-5d068aa0995c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:31:44 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e433ed-2f60-4fcb-bbfe-2bf02f192671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6165c0-d585-4b16-91e7-9687ec524252', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:44 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c 1073741824 Jul 09 01:31:44 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9256d62a-5b85-4e29-9eaf-3c78b865ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-9f6165c0-d585-4b16-91e7-9687ec524252 (9f6165c0-d585-4b16-91e7-9687ec524252): created successfully Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9256d62a-5b85-4e29-9eaf-3c78b865ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (055c811f-5ca0-465e-ac1a-28a2c64539dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5c89ed06-2193-4086-b7ed-f09f273c5001 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:45 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c 1073741824" returned: 0 in 0.910s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:45 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c Jul 09 01:31:45 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:46 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731cf88c-abdb-4988-8f96-ae5db30907a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c21930-4a84-4807-a526-5d068aa0995c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3533f-bdf9-4ed7-938a-486ef244544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:31:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Volume volume-07c21930-4a84-4807-a526-5d068aa0995c (07c21930-4a84-4807-a526-5d068aa0995c): created successfully Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3533f-bdf9-4ed7-938a-486ef244544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:31:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Flow 'volume_create_manager' (69024aee-c0ce-4069-a017-3fefa13d2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:31:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5d9a898e-3f00-4dfe-81b6-2bc6872fcf71 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created volume successfully. Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-07c21930-4a84-4807-a526-5d068aa0995c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-07c21930-4a84-4807-a526-5d068aa0995c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-07c21930-4a84-4807-a526-5d068aa0995c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-07c21930-4a84-4807-a526-5d068aa0995c" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7434b0-a0d2-4e76-bf28-3d2ef85ebca0]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:47 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c Jul 09 01:31:47 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:47 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c" returned: 0 in 0.766s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:47 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c Jul 09 01:31:47 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:48 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-07c21930-4a84-4807-a526-5d068aa0995c" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-07c21930-4a84-4807-a526-5d068aa0995c" released by "delete_volume" :: held 1.483s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['7199d00b-85cd-4d3b-a515-0bf859dc8638', '45299432-ea9d-473a-b88e-d887715620e0', '39b0bd77-0637-423a-9494-f14eba4d2fca', '0d9f84c2-6ce2-46b7-9f3b-4a3efdda5631'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:48 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:48 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-9f6165c0-d585-4b16-91e7-9687ec524252-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-9f6165c0-d585-4b16-91e7-9687ec524252-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-9f6165c0-d585-4b16-91e7-9687ec524252" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-9f6165c0-d585-4b16-91e7-9687ec524252" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:49 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.680s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc7a87b-1896-456e-ac04-63ad78cdc95a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4cd057f8-6157-4871-99cb-63f03f409501 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-07c21930-4a84-4807-a526-5d068aa0995c-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:49 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 Jul 09 01:31:49 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:50 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:50 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252 Jul 09 01:31:50 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:50 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-9f6165c0-d585-4b16-91e7-9687ec524252" returned: 0 in 0.683s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-9f6165c0-d585-4b16-91e7-9687ec524252" released by "delete_volume" :: held 1.534s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=63,cinder:INSERT=25,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:31:50 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=71,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=13 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['407b8a9d-3a92-4488-8297-ceaf07423248', 'd32c458f-efaa-4162-a6d5-11d52706fe86', '352d3b2f-4337-48b8-9ba1-cacf6ac19b06', '5eb76f0a-2749-4dc0-85e1-90b13bbee2dc'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:51 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:51 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-f5ded01e-948f-41e5-8f61-23dd8f12e062-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-f5ded01e-948f-41e5-8f61-23dd8f12e062-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-f5ded01e-948f-41e5-8f61-23dd8f12e062" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-f5ded01e-948f-41e5-8f61-23dd8f12e062" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2f3bed-93ff-49e1-ad3e-e8fbce375bda]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:51 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 Jul 09 01:31:51 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:51 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.728s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:31:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-71b6a0f1-e7aa-431a-bdbf-f2c04f24df2e tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-9f6165c0-d585-4b16-91e7-9687ec524252-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:52 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:52 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062 Jul 09 01:31:52 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:53 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5ded01e-948f-41e5-8f61-23dd8f12e062" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-f5ded01e-948f-41e5-8f61-23dd8f12e062" released by "delete_volume" :: held 1.502s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['1844efc2-0536-4fe1-a9c7-988d044499f9', 'e19d3fc6-df4c-4c7a-ac29-521ca152ef30', '00c26a8b-d168-452f-b227-a6504022b133', 'fea17628-b7b1-4b86-9165-2cc396b99401'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:53 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:53 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-1d85467f-6a8c-4996-86fa-3a9834ee6606-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-1d85467f-6a8c-4996-86fa-3a9834ee6606-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-1d85467f-6a8c-4996-86fa-3a9834ee6606" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-1d85467f-6a8c-4996-86fa-3a9834ee6606" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:53 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.649s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5a029-dea8-45ba-ada3-1602125d45a0]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-fa14cbdf-6103-4104-bfd0-51a617064cd1 tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-f5ded01e-948f-41e5-8f61-23dd8f12e062-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:54 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 Jul 09 01:31:54 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:54 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606" returned: 0 in 0.794s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:54 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606 Jul 09 01:31:54 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:55 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-1d85467f-6a8c-4996-86fa-3a9834ee6606" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-1d85467f-6a8c-4996-86fa-3a9834ee6606" released by "delete_volume" :: held 1.521s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['8dad9511-4322-4afa-b67d-538e0b1055d9', '1cec7ce9-1c49-44f6-a4a7-ef28231c65ff', '5e76bfdb-5225-4b9a-9aef-b28fd83391b3', '2553fdd9-7128-4972-ab80-1a42a6fc6bf5'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:55 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:55 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-f845a1a5-9c75-42c5-be9f-48433242a2df-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-f845a1a5-9c75-42c5-be9f-48433242a2df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-f845a1a5-9c75-42c5-be9f-48433242a2df" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-f845a1a5-9c75-42c5-be9f-48433242a2df" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038046c-e95c-484a-8a85-fdb311b56bde]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:56 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.698s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2d06a367-c39c-4b6d-a674-07caaa2fccdc tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-1d85467f-6a8c-4996-86fa-3a9834ee6606-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:56 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df Jul 09 01:31:56 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:56 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df" returned: 0 in 0.758s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:56 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df Jul 09 01:31:56 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:57 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f845a1a5-9c75-42c5-be9f-48433242a2df" returned: 0 in 0.644s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-f845a1a5-9c75-42c5-be9f-48433242a2df" released by "delete_volume" :: held 1.444s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['3b97149c-b19a-4a1f-9991-33c21a4be7ee', 'f2e3d528-8005-48f0-a077-ffc05c203d64', '921d7351-c5ef-4780-8cab-c4f38b378dbd', 'eb46ba4f-ddc1-4743-bb8d-2f9569d22e10'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:57 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:57 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-d7b07fe9-e926-4e5c-838d-eba0a17d92f1-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-d7b07fe9-e926-4e5c-838d-eba0a17d92f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:58 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:31:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "cinder-quobyte-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-deed324f-cf12-4971-9641-97929fc8321a tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-f845a1a5-9c75-42c5-be9f-48433242a2df-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c094f-6b08-40b2-8dfd-408c2a6a0eb6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:31:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:58 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 Jul 09 01:31:58 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:59 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" returned: 0 in 0.747s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:59 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1 Jul 09 01:31:59 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:31:59 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" returned: 0 in 0.664s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-quobyte-d7b07fe9-e926-4e5c-838d-eba0a17d92f1" released by "delete_volume" :: held 1.453s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Created reservations ['f613ee4b-6066-4e2a-b293-eb04cb4198da', 'cb27a039-c574-430d-a6da-ef541e535ff2', 'efc10418-4851-41b1-b83c-07a8ef719e15', 'b7c55e04-c64c-47c7-b0f9-830a0088c6f4'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:31:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:31:59 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:31:59 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:00 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:00 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Deleted volume successfully. Jul 09 01:32:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5f74691c-ba94-4c53-9805-2dae4ff8ffed tempest-CreateVolumesFromSourceVolumeTest-1298300275 None] Lock "cinder-d7b07fe9-e926-4e5c-838d-eba0a17d92f1-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (23418622-d31d-4981-a964-c7728d828528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aedf52-c6d7-46d3-b44b-cdbeea38fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aedf52-c6d7-46d3-b44b-cdbeea38fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875256871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb6423-13c8-4377-b171-ff3f2dcf4bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:08Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab836561-def2-4a77-97e5-8266ecf2b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab836561-def2-4a77-97e5-8266ecf2b233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5075ffbd-803f-4829-8d29-6e416c088915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5075ffbd-803f-4829-8d29-6e416c088915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eeb6423-13c8-4377-b171-ff3f2dcf4bcc', 'volume_name': 'volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cb2a52-9c90-457c-8a8b-b544a814c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cb2a52-9c90-457c-8a8b-b544a814c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddc3ca0-5228-4993-9bf6-790886ee540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:07 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Volume 5eeb6423-13c8-4377-b171-ff3f2dcf4bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc', 'volume_size': 1} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875256871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb6423-13c8-4377-b171-ff3f2dcf4bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:08Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Creating volume 5eeb6423-13c8-4377-b171-ff3f2dcf4bcc {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:07 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:07 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc 1073741824 Jul 09 01:32:07 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:08 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc 1073741824" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:08 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc Jul 09 01:32:08 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:09 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" returned: 0 in 0.654s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddc3ca0-5228-4993-9bf6-790886ee540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7b7c4-2c60-4ebe-9c0b-30cb6a8d2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Volume volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc (5eeb6423-13c8-4377-b171-ff3f2dcf4bcc): created successfully Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7b7c4-2c60-4ebe-9c0b-30cb6a8d2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (23418622-d31d-4981-a964-c7728d828528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:09 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-709f3de9-ae54-481b-994c-f74928768a00 tempest-ProjectReaderTests-1436415610 None] Created volume successfully. Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "cinder-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-quobyte-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b77c2-14b3-411f-87db-4a6da7cf2647]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:10 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc Jul 09 01:32:10 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:10 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" returned: 0 in 0.744s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:10 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc Jul 09 01:32:10 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:11 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc" released by "delete_volume" :: held 1.442s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Created reservations ['24293eb7-fb9b-41b6-b461-e602d57eaa15', 'b95e8b79-417e-4333-b6a7-f8b405455497', '9a3b47c9-c209-4e1a-a7f2-73814c7843b8', 'aeb160d2-ac0e-407c-9a6d-05bab5fffe68'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:11 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:11 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:12 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.661s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:12 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Deleted volume successfully. Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c732335a-b0bd-407c-bae6-cce56fd04d5f tempest-ProjectReaderTests-1436415610 None] Lock "cinder-5eeb6423-13c8-4377-b171-ff3f2dcf4bcc-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (b3d096ec-302e-4583-8998-8260ba2da408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef07b6fe-9727-4995-9a71-5d861ba34290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef07b6fe-9727-4995-9a71-5d861ba34290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191364425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cd9f40-72e3-4533-b2a4-3e17c3ae0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:13Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76416ec5-44e7-47d7-bd76-9e3b1105a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76416ec5-44e7-47d7-bd76-9e3b1105a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c3702a-7ba7-4237-89f3-2cb474ae18fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c3702a-7ba7-4237-89f3-2cb474ae18fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cd9f40-72e3-4533-b2a4-3e17c3ae0974', 'volume_name': 'volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476ef36b-f027-42c6-b0d4-10cd91fb11dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476ef36b-f027-42c6-b0d4-10cd91fb11dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4472d856-c7f2-4026-b1a4-e3ec1ad2a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Volume e9cd9f40-72e3-4533-b2a4-3e17c3ae0974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974', 'volume_size': 1} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191364425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cd9f40-72e3-4533-b2a4-3e17c3ae0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:13Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Creating volume e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:12 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:12 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 1073741824 Jul 09 01:32:12 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:13 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 1073741824" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:13 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 Jul 09 01:32:13 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:14 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" returned: 0 in 0.638s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4472d856-c7f2-4026-b1a4-e3ec1ad2a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74aa0b-0b1f-4b30-b2bd-e60b26656439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Volume volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 (e9cd9f40-72e3-4533-b2a4-3e17c3ae0974): created successfully Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74aa0b-0b1f-4b30-b2bd-e60b26656439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (b3d096ec-302e-4583-8998-8260ba2da408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c455b934-9d27-4222-9c2f-05a4d46668a8 tempest-ProjectReaderTests-1436415610 None] Created volume successfully. Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-quobyte-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91603717-20b6-4711-bba0-66d0d51475ed]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:14 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 Jul 09 01:32:14 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:15 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" returned: 0 in 0.784s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:15 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974 Jul 09 01:32:15 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:16 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" returned: 0 in 0.681s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974" released by "delete_volume" :: held 1.504s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Created reservations ['8efeaa66-ebcb-49ef-baad-2fbc3bc68e4b', '589d3d6e-3425-4592-88d0-5144d74c3c26', '93aaf6b3-245f-4048-af9c-e27baa378787', 'b390fa76-5129-45f9-aa7f-cc9e6d6f6eee'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:16 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:16 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:17 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Deleted volume successfully. Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6b307cb3-cae5-4478-b572-50bec13c27b5 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-e9cd9f40-72e3-4533-b2a4-3e17c3ae0974-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (43b8b93b-a7f6-43e9-9987-78a000934328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d739a8-07ed-4221-b128-a05c22ce9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d739a8-07ed-4221-b128-a05c22ce9465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351913289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cd30a2-722f-4f59-b0c1-b0940c1add15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:17Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc8d44-685f-44c2-9a11-7c9b50b9c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc8d44-685f-44c2-9a11-7c9b50b9c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce5a71-e1b5-49c4-af1e-96bb73ba6714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce5a71-e1b5-49c4-af1e-96bb73ba6714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cd30a2-722f-4f59-b0c1-b0940c1add15', 'volume_name': 'volume-55cd30a2-722f-4f59-b0c1-b0940c1add15', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e2fee3-23bc-467a-9965-6b75d03a1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e2fee3-23bc-467a-9965-6b75d03a1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b8ccb-daa1-4c05-8e76-af9fbf4d1baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:17 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Volume 55cd30a2-722f-4f59-b0c1-b0940c1add15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cd30a2-722f-4f59-b0c1-b0940c1add15', 'volume_size': 1} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351913289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cd30a2-722f-4f59-b0c1-b0940c1add15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:17Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Creating volume 55cd30a2-722f-4f59-b0c1-b0940c1add15 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:17 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 1073741824 Jul 09 01:32:17 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:18 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 1073741824" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:18 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 Jul 09 01:32:18 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:18 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b8ccb-daa1-4c05-8e76-af9fbf4d1baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cd30a2-722f-4f59-b0c1-b0940c1add15', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dffc5c-25c3-49c9-9c5e-c13772d57eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Volume volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 (55cd30a2-722f-4f59-b0c1-b0940c1add15): created successfully Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dffc5c-25c3-49c9-9c5e-c13772d57eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (43b8b93b-a7f6-43e9-9987-78a000934328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0a787317-7813-47ed-bf25-9ec528611338 tempest-ProjectReaderTests-1436415610 None] Created volume successfully. Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-55cd30a2-722f-4f59-b0c1-b0940c1add15-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-55cd30a2-722f-4f59-b0c1-b0940c1add15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-quobyte-55cd30a2-722f-4f59-b0c1-b0940c1add15" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-55cd30a2-722f-4f59-b0c1-b0940c1add15" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c1764d-8210-4182-9847-7c5b8915f306]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:19 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 Jul 09 01:32:19 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:20 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15" returned: 0 in 0.751s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:20 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15 Jul 09 01:32:20 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:21 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-55cd30a2-722f-4f59-b0c1-b0940c1add15" returned: 0 in 0.648s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-55cd30a2-722f-4f59-b0c1-b0940c1add15" released by "delete_volume" :: held 1.435s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Created reservations ['eb847aa5-5157-4191-8576-741ecfd6bde1', '33476b15-a6f4-4dcc-a3d4-1caacfe5abea', 'b4c1ff9e-418f-4db2-b89d-3e4bc32b54c1', 'ea39df11-5e8d-4ed2-89d5-9ca23dbcdd2d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:21 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:21 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:21 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.656s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Deleted volume successfully. Jul 09 01:32:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0460acb7-69ee-4f7a-9a18-6db17b51c031 tempest-ProjectReaderTests-1436415610 None] Lock "cinder-55cd30a2-722f-4f59-b0c1-b0940c1add15-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (ffcc9876-e82b-4fc9-bcb0-1fed264bb1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9c56c-0dc4-4850-9d23-0b4b86144c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9c56c-0dc4-4850-9d23-0b4b86144c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1675659918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c615419-8859-4c09-96e3-767b785adefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:22Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02239a1-983a-46e0-a9c1-fa7610f785f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02239a1-983a-46e0-a9c1-fa7610f785f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c873b490-6e5e-4086-8e73-73a72b4db398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c873b490-6e5e-4086-8e73-73a72b4db398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c615419-8859-4c09-96e3-767b785adefd', 'volume_name': 'volume-0c615419-8859-4c09-96e3-767b785adefd', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912318f7-e2c2-4451-a53f-30979c4ba07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912318f7-e2c2-4451-a53f-30979c4ba07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf582b-c188-4ca8-812b-b5f1d101f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Volume 0c615419-8859-4c09-96e3-767b785adefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c615419-8859-4c09-96e3-767b785adefd', 'volume_size': 1} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1675659918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c615419-8859-4c09-96e3-767b785adefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd532d174b42f793c32342a760046d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:22Z,use_quota=True,user_id='4b651164b0024e9eb2619be27b9e0e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Creating volume 0c615419-8859-4c09-96e3-767b785adefd {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:22 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:22 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd 1073741824 Jul 09 01:32:22 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:23 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd 1073741824" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:23 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd Jul 09 01:32:23 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:23 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf582b-c188-4ca8-812b-b5f1d101f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c615419-8859-4c09-96e3-767b785adefd', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88dc91c-46cd-4d4b-9b54-cc6fb4e9f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Volume volume-0c615419-8859-4c09-96e3-767b785adefd (0c615419-8859-4c09-96e3-767b785adefd): created successfully Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88dc91c-46cd-4d4b-9b54-cc6fb4e9f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Flow 'volume_create_manager' (ffcc9876-e82b-4fc9-bcb0-1fed264bb1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7f3cba74-79d0-45d6-9257-d63841374784 tempest-ProjectReaderTests-1436415610 None] Created volume successfully. Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-0c615419-8859-4c09-96e3-767b785adefd-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "cinder-0c615419-8859-4c09-96e3-767b785adefd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Acquiring lock "cinder-quobyte-0c615419-8859-4c09-96e3-767b785adefd" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-0c615419-8859-4c09-96e3-767b785adefd" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f5453-fa4c-4da3-b50b-355f9e8646d3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:24 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd Jul 09 01:32:24 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:25 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd" returned: 0 in 0.734s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:25 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd Jul 09 01:32:25 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:25 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-0c615419-8859-4c09-96e3-767b785adefd" returned: 0 in 0.630s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "cinder-quobyte-0c615419-8859-4c09-96e3-767b785adefd" released by "delete_volume" :: held 1.400s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Created reservations ['c44c6258-f237-41b3-9498-0810f12573da', '954c0160-1452-40c6-a1b7-e66f522a2c26', '39e9d28b-b398-42d8-a427-d525a8516edc', '5fe592c1-0d21-4607-a31b-cfac52c9baa2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:25 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:25 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:26 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.641s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:26 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Deleted volume successfully. Jul 09 01:32:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-edca5474-f2bd-400e-9341-183c3ac1c07e tempest-ProjectReaderTests-1436415610 None] Lock "cinder-0c615419-8859-4c09-96e3-767b785adefd-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:33 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:33 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:34 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.668s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:32:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:32:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:32:35 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:INSERT=19,cinder:UPDATE=86,cinder:SELECT=52,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:32:36 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=51,cinder:INSERT=21,cinder:UPDATE=82,cinder:DELETE=11 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Flow 'volume_create_manager' (a58f3adb-1e83-4351-92d0-dd774d4f28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b01f2aa-5cd6-4901-8dd8-f6d67480e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b01f2aa-5cd6-4901-8dd8-f6d67480e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1369639257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef807f0-7492-48d7-aed2-bd0a543854ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1be3bf47af4fe5bb289fa130aa1096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='8e1ef539c6f248869fedbb6effb196c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1a8cd-d6f8-4282-9764-9a3cbd41bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1a8cd-d6f8-4282-9764-9a3cbd41bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9ce307-0671-4cd3-9b21-9ab1567887e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9ce307-0671-4cd3-9b21-9ab1567887e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef807f0-7492-48d7-aed2-bd0a543854ca', 'volume_name': 'volume-aef807f0-7492-48d7-aed2-bd0a543854ca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5045258-c784-499a-8c49-1e4529d2fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5045258-c784-499a-8c49-1e4529d2fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746e7c18-0dd7-4b65-9133-8b929cd14f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Volume aef807f0-7492-48d7-aed2-bd0a543854ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef807f0-7492-48d7-aed2-bd0a543854ca', 'volume_size': 1} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1369639257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef807f0-7492-48d7-aed2-bd0a543854ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1be3bf47af4fe5bb289fa130aa1096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='8e1ef539c6f248869fedbb6effb196c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Creating volume aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:39 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:39 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca 1073741824 Jul 09 01:32:39 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (18864eed-7a16-427f-9929-a7cbff2ced0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20adda8-5bcb-46de-b596-f44aaf89d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20adda8-5bcb-46de-b596-f44aaf89d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1402231698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7210d93-4721-4dea-9a5e-7f961df72d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03bf7d6-e541-48be-b728-4d9213407e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03bf7d6-e541-48be-b728-4d9213407e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757b6eae-3e42-4f8f-ba05-a8be2176d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757b6eae-3e42-4f8f-ba05-a8be2176d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7210d93-4721-4dea-9a5e-7f961df72d98', 'volume_name': 'volume-a7210d93-4721-4dea-9a5e-7f961df72d98', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5789ccab-2df9-4570-b727-8470935620b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5789ccab-2df9-4570-b727-8470935620b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87beb20e-b4a5-4a04-b4be-110ebc618172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Volume a7210d93-4721-4dea-9a5e-7f961df72d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7210d93-4721-4dea-9a5e-7f961df72d98', 'volume_size': 1} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (3f43120f-adfb-4511-8aa2-89c879f98f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd886f8d-b9b6-453c-8ad2-5365e2e50eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd886f8d-b9b6-453c-8ad2-5365e2e50eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812188791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c791324-42e0-4234-b912-98affb6bf0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0051ae16-5c3d-4c17-b314-c6e48026d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0051ae16-5c3d-4c17-b314-c6e48026d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b313f31-f02a-4ef8-b421-91452c8feec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b313f31-f02a-4ef8-b421-91452c8feec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c791324-42e0-4234-b912-98affb6bf0b5', 'volume_name': 'volume-8c791324-42e0-4234-b912-98affb6bf0b5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e246a8-71fa-461f-91df-75018fc39044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e246a8-71fa-461f-91df-75018fc39044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e88088-5c7c-425a-822e-e1879045e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Volume 8c791324-42e0-4234-b912-98affb6bf0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c791324-42e0-4234-b912-98affb6bf0b5', 'volume_size': 1} Jul 09 01:32:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (46ab30a9-bec1-44ea-b27d-26c1f47e0391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806a074-1ecf-4010-b718-a7045145317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1806a074-1ecf-4010-b718-a7045145317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613408069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923ec435-c005-41ea-8777-4f3791a86567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:40Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494b3780-377b-4922-b7c5-ca24c6c93034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494b3780-377b-4922-b7c5-ca24c6c93034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c8004e-2e1f-4bb8-8610-19108f2af06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c8004e-2e1f-4bb8-8610-19108f2af06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923ec435-c005-41ea-8777-4f3791a86567', 'volume_name': 'volume-923ec435-c005-41ea-8777-4f3791a86567', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c981a30-d481-462e-80c7-dfa8bd43fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c981a30-d481-462e-80c7-dfa8bd43fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20e4b29-6f89-4937-a48f-0bd1b318af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Volume 923ec435-c005-41ea-8777-4f3791a86567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923ec435-c005-41ea-8777-4f3791a86567', 'volume_size': 1} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:40 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca 1073741824" returned: 0 in 1.250s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:40 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:32:40 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (5dec897f-c57f-49d5-89e4-98cd64f23b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69f091-1287-48f0-82b2-f92ae7375bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f69f091-1287-48f0-82b2-f92ae7375bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086374442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c33fa3-bdeb-4dcc-af64-ff64a033a613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:41Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0189b6-6cb4-4752-b202-5ea6c5323ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0189b6-6cb4-4752-b202-5ea6c5323ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0a5987-40bd-4f49-aa5b-b58b44f22615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0a5987-40bd-4f49-aa5b-b58b44f22615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c33fa3-bdeb-4dcc-af64-ff64a033a613', 'volume_name': 'volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d539bf-5caf-4d86-b478-2cad647c5cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d539bf-5caf-4d86-b478-2cad647c5cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dfcb8c-0fb7-47f5-b658-0dca6f98bbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:40 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Volume 13c33fa3-bdeb-4dcc-af64-ff64a033a613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613', 'volume_size': 1} Jul 09 01:32:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (43fcbf47-1836-4c21-9a47-45ddd2607883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e772ca-c79c-448a-a518-3526f2b1d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e772ca-c79c-448a-a518-3526f2b1d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534152466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c379da4a-b9f7-4d62-97ca-43a845dd408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:41Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9178ff0-b200-4f00-9bca-3bfd40bf2e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9178ff0-b200-4f00-9bca-3bfd40bf2e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961febe7-e6df-4f95-bde9-90990bf09055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961febe7-e6df-4f95-bde9-90990bf09055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c379da4a-b9f7-4d62-97ca-43a845dd408f', 'volume_name': 'volume-c379da4a-b9f7-4d62-97ca-43a845dd408f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56fd1f7-a8df-4a63-8c84-2f8c8eb6b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56fd1f7-a8df-4a63-8c84-2f8c8eb6b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393faee-7033-4183-9726-ec8f5c937907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Volume c379da4a-b9f7-4d62-97ca-43a845dd408f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c379da4a-b9f7-4d62-97ca-43a845dd408f', 'volume_size': 1} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:41 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 0.861s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1402231698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7210d93-4721-4dea-9a5e-7f961df72d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Creating volume a7210d93-4721-4dea-9a5e-7f961df72d98 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:41 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746e7c18-0dd7-4b65-9133-8b929cd14f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef807f0-7492-48d7-aed2-bd0a543854ca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 1073741824 Jul 09 01:32:41 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c228d2fe-dc42-40ae-838e-42eca59a3c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Volume volume-aef807f0-7492-48d7-aed2-bd0a543854ca (aef807f0-7492-48d7-aed2-bd0a543854ca): created successfully Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c228d2fe-dc42-40ae-838e-42eca59a3c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Flow 'volume_create_manager' (a58f3adb-1e83-4351-92d0-dd774d4f28a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d5e8d042-e5c1-4e30-b5da-ffeb3145b787 tempest-VolumeDependencyTests-1122123020 None] Created volume successfully. Jul 09 01:32:42 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 1073741824" returned: 0 in 1.045s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:42 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 Jul 09 01:32:42 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:43 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98" returned: 0 in 0.702s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.644s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812188791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c791324-42e0-4234-b912-98affb6bf0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:39Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Creating volume 8c791324-42e0-4234-b912-98affb6bf0b5 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:43 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87beb20e-b4a5-4a04-b4be-110ebc618172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7210d93-4721-4dea-9a5e-7f961df72d98', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:43 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 1073741824 Jul 09 01:32:43 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2d6f0c-4e7d-47e8-9c3e-0342ad2bd0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Volume volume-a7210d93-4721-4dea-9a5e-7f961df72d98 (a7210d93-4721-4dea-9a5e-7f961df72d98): created successfully Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2d6f0c-4e7d-47e8-9c3e-0342ad2bd0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (18864eed-7a16-427f-9929-a7cbff2ced0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f53a9dcf-a1a6-437e-994a-52f4b814c9c2 tempest-CreateVolumesFromImageTest-1825832039 None] Created volume successfully. Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Flow 'volume_create_manager' (ae80e433-1160-42ef-87ca-bfbbc847a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e7c473-eb8e-4b84-9d00-d2a2ad963821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e7c473-eb8e-4b84-9d00-d2a2ad963821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0825c24-9a6f-4271-b3c9-e5228118173c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4eb00cb02914fb2a1e0f3eba52fab00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:44Z,use_quota=True,user_id='e0d27bc429f8462793fb39714e98b88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a828f1e-624d-4b0b-8267-2e01a3eccfdf),volume_type_id=0a828f1e-624d-4b0b-8267-2e01a3eccfdf)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7815aba-2f6a-4cd3-9ffd-ee04bb97bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7815aba-2f6a-4cd3-9ffd-ee04bb97bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924576c5-3eaf-411a-8371-1b318247cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:43 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924576c5-3eaf-411a-8371-1b318247cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0825c24-9a6f-4271-b3c9-e5228118173c', 'volume_name': 'volume-a0825c24-9a6f-4271-b3c9-e5228118173c', 'volume_size': 1, 'image_id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20c6a0acc74fbcf3d76ddc5b3df9f59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4eb00cb02914fb2a1e0f3eba52fab00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd045a45b072a36d2b8ac192029e76453968458665515e9c7ef257916b5ff81b693430d9fb8972ab0ea13294c6530b947fcbd22f18b2e1b57f734e1503d6a37b1', 'id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'created_at': datetime.datetime(2026, 7, 8, 23, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276363a8-9ee7-4e6c-95ec-9dd257d78131/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15568d12-f447-411e-924d-d00147b0c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15568d12-f447-411e-924d-d00147b0c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a2d25b-a3d6-4131-b3fe-a1c82624e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Volume a0825c24-9a6f-4271-b3c9-e5228118173c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0825c24-9a6f-4271-b3c9-e5228118173c', 'volume_size': 1, 'image_id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20c6a0acc74fbcf3d76ddc5b3df9f59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4eb00cb02914fb2a1e0f3eba52fab00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd045a45b072a36d2b8ac192029e76453968458665515e9c7ef257916b5ff81b693430d9fb8972ab0ea13294c6530b947fcbd22f18b2e1b57f734e1503d6a37b1', 'id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'created_at': datetime.datetime(2026, 7, 8, 23, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276363a8-9ee7-4e6c-95ec-9dd257d78131/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Trying to clone a0825c24-9a6f-4271-b3c9-e5228118173c from image 276363a8-9ee7-4e6c-95ec-9dd257d78131 at location (None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:32:44 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Image download 0.00 MB at 0.00 MB/s Jul 09 01:32:44 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 1073741824" returned: 0 in 1.051s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931ee32-69a8-4634-9c20-04f81a374f7b]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:44 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 Jul 09 01:32:44 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:44 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:44 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:45 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.751s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613408069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923ec435-c005-41ea-8777-4f3791a86567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:40Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Creating volume 923ec435-c005-41ea-8777-4f3791a86567 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:45 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e88088-5c7c-425a-822e-e1879045e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c791324-42e0-4234-b912-98affb6bf0b5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9985cacd-bb46-46d3-859b-424d02b22e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:45 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 1073741824 Jul 09 01:32:45 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:45 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Volume volume-8c791324-42e0-4234-b912-98affb6bf0b5 (8c791324-42e0-4234-b912-98affb6bf0b5): created successfully Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9985cacd-bb46-46d3-859b-424d02b22e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (3f43120f-adfb-4511-8aa2-89c879f98f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ef0d5967-0055-446a-b4d5-644aba7e0c88 tempest-CreateVolumesFromImageTest-1825832039 None] Created volume successfully. Jul 09 01:32:45 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:45 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:45 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:46 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 1 in 0.822s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Temporary image 276363a8-9ee7-4e6c-95ec-9dd257d78131 is fetched for user e0d27bc429f8462793fb39714e98b88d. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:32:46 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 1073741824" returned: 0 in 0.970s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf36b6d-c49e-4d66-9c2f-ee8b018cc113]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:46 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 Jul 09 01:32:46 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:46 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:46 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:46 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567" returned: 0 in 0.739s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.023s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086374442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c33fa3-bdeb-4dcc-af64-ff64a033a613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:41Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Creating volume 13c33fa3-bdeb-4dcc-af64-ff64a033a613 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:46 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:46 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 1073741824 Jul 09 01:32:46 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20e4b29-6f89-4937-a48f-0bd1b318af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923ec435-c005-41ea-8777-4f3791a86567', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84e1617-470c-41cc-a288-3a14bd97cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Volume volume-923ec435-c005-41ea-8777-4f3791a86567 (923ec435-c005-41ea-8777-4f3791a86567): created successfully Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84e1617-470c-41cc-a288-3a14bd97cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (46ab30a9-bec1-44ea-b27d-26c1f47e0391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:46 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-add38135-2507-47ae-9b56-bc32619851c5 tempest-CreateVolumesFromImageTest-1825832039 None] Created volume successfully. Jul 09 01:32:47 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:47 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:47 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 1 in 0.838s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:32:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:47 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 1073741824" returned: 0 in 1.019s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:47 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 Jul 09 01:32:47 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:48 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613" returned: 0 in 0.702s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.510s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534152466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c379da4a-b9f7-4d62-97ca-43a845dd408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f27d0e82b44b139dc834a5f99cdf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:41Z,use_quota=True,user_id='3443fabe967a4450a946eb3f76921a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Creating volume c379da4a-b9f7-4d62-97ca-43a845dd408f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:48 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:48 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f 1073741824 Jul 09 01:32:48 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dfcb8c-0fb7-47f5-b658-0dca6f98bbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbf95c5-708a-4ada-9b7e-5d9866475a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:48 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Volume volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 (13c33fa3-bdeb-4dcc-af64-ff64a033a613): created successfully Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbf95c5-708a-4ada-9b7e-5d9866475a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (5dec897f-c57f-49d5-89e4-98cd64f23b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-375c8bf4-93d5-4325-b931-d1bad2fa092e tempest-CreateVolumesFromImageTest-1825832039 None] Created volume successfully. Jul 09 01:32:49 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f 1073741824" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:49 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f Jul 09 01:32:49 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:50 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f" returned: 0 in 0.653s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.682s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6393faee-7033-4183-9726-ec8f5c937907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c379da4a-b9f7-4d62-97ca-43a845dd408f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879406a-7fc2-4698-a0b4-b7905c00eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Creating offline snapshot 968eb1f2-0e24-478d-a591-aba70c11103c of volume aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:32:50 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Volume volume-c379da4a-b9f7-4d62-97ca-43a845dd408f (c379da4a-b9f7-4d62-97ca-43a845dd408f): created successfully Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879406a-7fc2-4698-a0b4-b7905c00eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Flow 'volume_create_manager' (43fcbf47-1836-4c21-9a47-45ddd2607883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57a0a3-5ae6-4bc8-95be-ac70f184dec3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6be498fe-d699-438d-b257-4e0aeccbaba8 tempest-CreateVolumesFromImageTest-1825832039 None] Created volume successfully. Jul 09 01:32:50 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:32:50 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-c379da4a-b9f7-4d62-97ca-43a845dd408f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-c379da4a-b9f7-4d62-97ca-43a845dd408f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:51 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 0.788s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-quobyte-c379da4a-b9f7-4d62-97ca-43a845dd408f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:51 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c 1G Jul 09 01:32:51 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-c379da4a-b9f7-4d62-97ca-43a845dd408f" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c516c82-0bd0-480d-b25f-0c82386f850d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:51 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f Jul 09 01:32:51 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:51 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c 1G" returned: 0 in 0.892s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef807f0-7492-48d7-aed2-bd0a543854ca -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:52 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef807f0-7492-48d7-aed2-bd0a543854ca -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:32:52 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:52 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f" returned: 0 in 0.931s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:52 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f Jul 09 01:32:52 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:52 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef807f0-7492-48d7-aed2-bd0a543854ca -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.796s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:52 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c is being set with open permissions: ugo+rw Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:52 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:32:52 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:52 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-c379da4a-b9f7-4d62-97ca-43a845dd408f" returned: 0 in 0.769s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-c379da4a-b9f7-4d62-97ca-43a845dd408f" released by "delete_volume" :: held 1.753s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:52 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Created reservations ['82525d62-4bf0-4f69-94a2-2deff9b04613', 'f90ec5bd-c4ca-47ad-8a06-dacb6c91eb1a', 'dbecf4ae-9b1e-4e81-b8a9-f0c2b479dd36', '3ac1cb86-c43b-4ad8-a906-a3ca95e706a7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:53 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:53 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-13c33fa3-bdeb-4dcc-af64-ff64a033a613-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-13c33fa3-bdeb-4dcc-af64-ff64a033a613-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-quobyte-13c33fa3-bdeb-4dcc-af64-ff64a033a613" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-13c33fa3-bdeb-4dcc-af64-ff64a033a613" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:53 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.732s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c9ec4-996c-4036-83c6-c1dc1a02901a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:53 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info Jul 09 01:32:53 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:53 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 Jul 09 01:32:53 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:53 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.834s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Deleted volume successfully. Jul 09 01:32:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-37d63ac0-03d2-40c4-a0ad-06002cf873d1 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-c379da4a-b9f7-4d62-97ca-43a845dd408f-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:54 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:54 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info is being set with open permissions: ugo+rw Jul 09 01:32:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:54 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info Jul 09 01:32:54 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:54 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613" returned: 0 in 0.954s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:54 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613 Jul 09 01:32:54 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:55 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.info" returned: 0 in 0.740s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.832s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.285s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0825c24-9a6f-4271-b3c9-e5228118173c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4eb00cb02914fb2a1e0f3eba52fab00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:44Z,use_quota=True,user_id='e0d27bc429f8462793fb39714e98b88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a828f1e-624d-4b0b-8267-2e01a3eccfdf),volume_type_id=0a828f1e-624d-4b0b-8267-2e01a3eccfdf)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Creating volume a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:55 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-80eb4a52-de3b-4df9-8f7a-9bea7b23fece tempest-VolumeDependencyTests-1122123020 None] Create snapshot completed successfully Jul 09 01:32:55 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1073741824 Jul 09 01:32:55 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:55 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-13c33fa3-bdeb-4dcc-af64-ff64a033a613" returned: 0 in 0.770s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-13c33fa3-bdeb-4dcc-af64-ff64a033a613" released by "delete_volume" :: held 1.784s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Created reservations ['52653d5e-6b10-471b-91ba-d8b4410c067a', 'f3218532-967e-4758-ac53-e786d255febc', '4f421c73-5d9e-4ed6-b55a-925fabbfb3e8', 'bac45c75-4a41-465b-874c-1e4077d75dc4'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:55 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:55 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-923ec435-c005-41ea-8777-4f3791a86567-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-923ec435-c005-41ea-8777-4f3791a86567-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-quobyte-923ec435-c005-41ea-8777-4f3791a86567" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-923ec435-c005-41ea-8777-4f3791a86567" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c5341-1aac-4208-974e-ee0c3e58dbb7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:55 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 Jul 09 01:32:55 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:55 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1073741824" returned: 0 in 0.898s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:56 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:32:56 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:56 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.779s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Deleted volume successfully. Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-972641b9-5ee8-4be4-9fac-3e02237eb4b6 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-13c33fa3-bdeb-4dcc-af64-ff64a033a613-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:56 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567" returned: 0 in 0.950s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:56 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567 Jul 09 01:32:56 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:56 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 0 in 0.888s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:56 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Attempting download of 276363a8-9ee7-4e6c-95ec-9dd257d78131 ((None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}])) to volume a0825c24-9a6f-4271-b3c9-e5228118173c. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Flow 'volume_create_manager' (da628b43-f623-40e7-8732-ba03ad7d519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eac201-cdc1-421c-8cdb-307c0423b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c0fe6c-b223-4f9a-a872-667c919c9986]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__ {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eac201-cdc1-421c-8cdb-307c0423b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-140887846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e59719-d13a-46f1-98d0-896dd5684dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1be3bf47af4fe5bb289fa130aa1096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=968eb1f2-0e24-478d-a591-aba70c11103c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:32:57Z,use_quota=True,user_id='8e1ef539c6f248869fedbb6effb196c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda6fa7d-8cc0-4416-af1e-8e9f332a7d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda6fa7d-8cc0-4416-af1e-8e9f332a7d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5829073-830e-4fcc-b88a-af0f33c4b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5829073-830e-4fcc-b88a-af0f33c4b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10e59719-d13a-46f1-98d0-896dd5684dec', 'volume_name': 'volume-10e59719-d13a-46f1-98d0-896dd5684dec', 'volume_size': 1, 'snapshot_id': '968eb1f2-0e24-478d-a591-aba70c11103c'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de162b6-3620-4f55-9ed8-e0b15a88391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de162b6-3620-4f55-9ed8-e0b15a88391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd76f02-bc5e-49cb-9a2f-7e41780c44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:32:57 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Volume 10e59719-d13a-46f1-98d0-896dd5684dec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10e59719-d13a-46f1-98d0-896dd5684dec', 'volume_size': 1, 'snapshot_id': '968eb1f2-0e24-478d-a591-aba70c11103c'} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c-10e59719-d13a-46f1-98d0-896dd5684dec" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c-10e59719-d13a-46f1-98d0-896dd5684dec" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Creating volume 10e59719-d13a-46f1-98d0-896dd5684dec from snapshot 968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] snapshot: 968eb1f2-0e24-478d-a591-aba70c11103c, volume: 10e59719-d13a-46f1-98d0-896dd5684dec, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:32:57 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__ Jul 09 01:32:57 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c99df-f637-4037-bbcb-d3bbf19b7e8f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:57 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:32:57 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:57 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-923ec435-c005-41ea-8777-4f3791a86567" returned: 0 in 0.994s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-923ec435-c005-41ea-8777-4f3791a86567" released by "delete_volume" :: held 2.002s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Created reservations ['d8ae0066-9e9d-4d89-bac5-80cd47966be7', '19618f9d-2022-465e-8cde-9cbab2ae98e1', '1c946168-5138-4bc4-9617-fbb2561ff528', 'af24ed64-b267-4802-ab28-24a8138c4192'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:57 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:32:57 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-8c791324-42e0-4234-b912-98affb6bf0b5-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:57 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__" returned: 0 in 0.933s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__ {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-8c791324-42e0-4234-b912-98affb6bf0b5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-quobyte-8c791324-42e0-4234-b912-98affb6bf0b5" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-8c791324-42e0-4234-b912-98affb6bf0b5" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a291a-b5b3-4b8c-b3af-0646a5f7f88a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:58 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:58 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__ Jul 09 01:32:58 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef807f0-7492-48d7-aed2-bd0a543854ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9f6779-30f2-4866-803c-5d8f5d3054f6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:58 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 Jul 09 01:32:58 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:58 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:32:58 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:58 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:32:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Deleted volume successfully. Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5daa7668-e411-42ec-a2e8-6b7c55e311f4 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-923ec435-c005-41ea-8777-4f3791a86567-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:58 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__" returned: 1 in 0.891s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_276363a8-9ee7-4e6c-95ec-9dd257d78131_stv969__' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff7ff3-88d2-49c0-b7d0-f91241e07ebf]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:32:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:59 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:59 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:59 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5" returned: 0 in 0.960s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:59 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 0.941s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:59 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5 Jul 09 01:32:59 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:59 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec Jul 09 01:32:59 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:59 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:32:59 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8c791324-42e0-4234-b912-98affb6bf0b5" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-8c791324-42e0-4234-b912-98affb6bf0b5" released by "delete_volume" :: held 1.800s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:32:59 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD Jul 09 01:32:59 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:32:59 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Created reservations ['adc59e33-25a4-4d69-8112-cbff54463adf', '0598aaa7-4bf3-49e2-8b28-dc1f01d545d7', '5e54a345-4c67-4082-90d1-c8f85024d4c6', '7fc2a3be-c966-4855-9e80-3eeadc74b19e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:00 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:00 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-a7210d93-4721-4dea-9a5e-7f961df72d98-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-a7210d93-4721-4dea-9a5e-7f961df72d98-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "cinder-quobyte-a7210d93-4721-4dea-9a5e-7f961df72d98" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-a7210d93-4721-4dea-9a5e-7f961df72d98" acquired by "delete_volume" :: waited 0.042s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c7395-d42f-4ed6-9d29-29234b7d6537]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:00 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 Jul 09 01:33:00 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:01 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD" returned: 1 in 2.134s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:33:01 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] 276363a8-9ee7-4e6c-95ec-9dd257d78131 was raw, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:33:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:02 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:02 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:02 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 2.363s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Deleted volume successfully. Jul 09 01:33:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-9195d6ca-f8c0-4520-88fd-8ab6e7d52369 tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-8c791324-42e0-4234-b912-98affb6bf0b5-delete_volume" released by "delete_volume" :: held 4.574s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:03 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98" returned: 0 in 2.354s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:03 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98 Jul 09 01:33:03 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:04 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 0 in 2.314s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:04 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_276363a8-9ee7-4e6c-95ec-9dd257d78131_ijw0jc3zdevstack@QuobyteHD, size 0.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:33:04 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 01:33:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:04 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1G Jul 09 01:33:04 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:04 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a7210d93-4721-4dea-9a5e-7f961df72d98" returned: 0 in 1.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-quobyte-a7210d93-4721-4dea-9a5e-7f961df72d98" released by "delete_volume" :: held 4.290s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Created reservations ['4b5b4f7c-149a-4530-9fb1-54661e146cfb', 'bae01906-25a8-4c20-861d-b36ee75851ad', 'c03b1ade-de01-4f34-a2d3-8218f579cf38', '208ac8a2-f575-41b2-9261-00e304f4921e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:05 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:05 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:06 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec" returned: 0 in 6.869s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5186760-222e-4ce0-a486-7fddb0bf3857]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:06 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:06 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:33:06 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c 1G" returned: 0 in 1.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee5d99-d1e9-4a6b-b2ef-62d3b4ab21cf]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:06 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:06 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:06 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.229s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Deleted volume successfully. Jul 09 01:33:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cc0357fe-e500-4d59-8456-fbbdc5ba14de tempest-CreateVolumesFromImageTest-1825832039 None] Lock "cinder-a7210d93-4721-4dea-9a5e-7f961df72d98-delete_volume" released by "delete_volume" :: held 6.145s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:07 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 0 in 0.972s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:07 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 1.349s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:07 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:33:07 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Converted 1024.00 MB image at 149.05 MB/s Jul 09 01:33:07 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec is being set with open permissions: ugo+rw Jul 09 01:33:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:07 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec Jul 09 01:33:07 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:07 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:07 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:08 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 1 in 1.055s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Downloaded image 276363a8-9ee7-4e6c-95ec-9dd257d78131 ((None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}])) to volume a0825c24-9a6f-4271-b3c9-e5228118173c successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Temporary image 276363a8-9ee7-4e6c-95ec-9dd257d78131 for user e0d27bc429f8462793fb39714e98b88d is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Marking volume a0825c24-9a6f-4271-b3c9-e5228118173c as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Copying metadata from image 276363a8-9ee7-4e6c-95ec-9dd257d78131 to a0825c24-9a6f-4271-b3c9-e5228118173c. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Creating volume glance metadata for volume a0825c24-9a6f-4271-b3c9-e5228118173c backed by image 276363a8-9ee7-4e6c-95ec-9dd257d78131 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c20c6a0acc74fbcf3d76ddc5b3df9f59', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:33:08 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec" returned: 0 in 0.998s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" released by "_copy_volume_from_snapshot" :: held 11.148s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c-10e59719-d13a-46f1-98d0-896dd5684dec" released by "_create_volume_from_snapshot" :: held 11.194s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.243s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd76f02-bc5e-49cb-9a2f-7e41780c44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e59719-d13a-46f1-98d0-896dd5684dec', 'volume_size': 1, 'snapshot_id': '968eb1f2-0e24-478d-a591-aba70c11103c'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3ae4bc-8042-4a9d-9127-496c5a1165a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Volume volume-10e59719-d13a-46f1-98d0-896dd5684dec (10e59719-d13a-46f1-98d0-896dd5684dec): created successfully Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3ae4bc-8042-4a9d-9127-496c5a1165a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Flow 'volume_create_manager' (da628b43-f623-40e7-8732-ba03ad7d519e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a2d25b-a3d6-4131-b3fe-a1c82624e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0825c24-9a6f-4271-b3c9-e5228118173c', 'volume_size': 1, 'image_id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/276363a8-9ee7-4e6c-95ec-9dd257d78131', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20c6a0acc74fbcf3d76ddc5b3df9f59', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4eb00cb02914fb2a1e0f3eba52fab00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd045a45b072a36d2b8ac192029e76453968458665515e9c7ef257916b5ff81b693430d9fb8972ab0ea13294c6530b947fcbd22f18b2e1b57f734e1503d6a37b1', 'id': '276363a8-9ee7-4e6c-95ec-9dd257d78131', 'created_at': datetime.datetime(2026, 7, 8, 23, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 32, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/276363a8-9ee7-4e6c-95ec-9dd257d78131/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d35cd4-f00f-4b5b-8495-d10d57f15f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c9df8874-8466-4ab4-9314-1e4b2de6d387 tempest-VolumeDependencyTests-1122123020 None] Created volume successfully. Jul 09 01:33:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Volume volume-a0825c24-9a6f-4271-b3c9-e5228118173c (a0825c24-9a6f-4271-b3c9-e5228118173c): created successfully Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d35cd4-f00f-4b5b-8495-d10d57f15f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Flow 'volume_create_manager' (ae80e433-1160-42ef-87ca-bfbbc847a234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7aa43cd7-b7ef-4649-a6a3-58553cba1f31 tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Created volume successfully. Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Acquiring lock "cinder-a0825c24-9a6f-4271-b3c9-e5228118173c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "cinder-a0825c24-9a6f-4271-b3c9-e5228118173c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Acquiring lock "cinder-quobyte-a0825c24-9a6f-4271-b3c9-e5228118173c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "cinder-quobyte-a0825c24-9a6f-4271-b3c9-e5228118173c" acquired by "delete_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-968eb1f2-0e24-478d-a591-aba70c11103c-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-968eb1f2-0e24-478d-a591-aba70c11103c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd5ad7-34d2-4d69-afde-4f46943f93d9]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Deleting offline snapshot 968eb1f2-0e24-478d-a591-aba70c11103c of volume aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] snapshot_file for this snap is: volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97b8f3-bfa2-4036-888a-7228a0b67893]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:09 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:09 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (e147fad5-c6ea-47ee-9120-b047fb7785f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec61ba7-1f2d-434c-97c2-75b65342b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec61ba7-1f2d-434c-97c2-75b65342b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140624070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff49da-602b-4868-8b73-10ad7372ac4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:10Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaec8a3-6e71-43ee-9468-ad62e9871bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaec8a3-6e71-43ee-9468-ad62e9871bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052ea4d5-cb98-4f67-9490-6490504da0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052ea4d5-cb98-4f67-9490-6490504da0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ff49da-602b-4868-8b73-10ad7372ac4f', 'volume_name': 'volume-31ff49da-602b-4868-8b73-10ad7372ac4f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e3662-a1e3-4680-a318-e3b38da393a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e3662-a1e3-4680-a318-e3b38da393a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c2b8f-7e1a-4162-a024-a2ff0fa598f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:09 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume 31ff49da-602b-4868-8b73-10ad7372ac4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ff49da-602b-4868-8b73-10ad7372ac4f', 'volume_size': 1} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140624070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff49da-602b-4868-8b73-10ad7372ac4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:10Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume 31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:09 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:33:09 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:09 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:09 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f 1073741824 Jul 09 01:33:09 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:10 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 0 in 1.071s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:10 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.961s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef807f0-7492-48d7-aed2-bd0a543854ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5271c37-0458-46b0-ba53-2a5d581e5811]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:10 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:10 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:10 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:33:10 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:11 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f 1073741824" returned: 0 in 1.127s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:11 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f Jul 09 01:33:11 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:11 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 1 in 0.871s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:11 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c Jul 09 01:33:11 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:11 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 0.908s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:11 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:33:11 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:11 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f" returned: 0 in 0.875s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c2b8f-7e1a-4162-a024-a2ff0fa598f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ff49da-602b-4868-8b73-10ad7372ac4f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00767f61-5f15-4bc5-bc55-050fe6a783c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-31ff49da-602b-4868-8b73-10ad7372ac4f (31ff49da-602b-4868-8b73-10ad7372ac4f): created successfully Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00767f61-5f15-4bc5-bc55-050fe6a783c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (e147fad5-c6ea-47ee-9120-b047fb7785f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:12 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-58125380-1a73-4f2c-b6ec-f77a8fa4d213 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:12 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-a0825c24-9a6f-4271-b3c9-e5228118173c" returned: 0 in 0.852s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "cinder-quobyte-a0825c24-9a6f-4271-b3c9-e5228118173c" released by "delete_volume" :: held 2.938s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Created reservations ['b7687dee-e359-4851-bd17-5be5e83e03c7', '0efc5625-517d-4d5c-8318-a3c7f68c1390', '87edf389-48b6-45e5-a7b0-71f21735e97a', '8bb6b88e-7253-4d14-b99f-3df9efb4bed9'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:12 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.844s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:12 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c Jul 09 01:33:12 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:12 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:12 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:13 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca.968eb1f2-0e24-478d-a591-aba70c11103c" returned: 0 in 0.870s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating offline snapshot 7dc10916-0b14-4f43-b1bf-fe70da0e43ce of volume 31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-968eb1f2-0e24-478d-a591-aba70c11103c" released by "_delete_snapshot" :: held 3.781s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" released by "delete_snapshot" :: held 3.828s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654eaee-9d79-41aa-8e58-73981a5100c4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:13 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.940s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Deleted volume successfully. Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2e64a0b-43bf-4ef9-a5fc-5e81cab602cc tempest-VolumeAndVolumeTypeFromImageTest-1413871107 None] Lock "cinder-a0825c24-9a6f-4271-b3c9-e5228118173c-delete_volume" released by "delete_volume" :: held 4.198s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Created reservations ['9e13a8ce-a4ce-40b5-aa7a-95234b0e5a01', 'e69f3955-3238-4dca-97f8-1d874859d088', 'deedd63d-e0e9-42a9-86a6-3d462d99f838', 'cb3d4b40-9f5c-4b6e-8976-41bdafbfa65d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Delete snapshot completed successfully. Jul 09 01:33:13 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f Jul 09 01:33:13 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6f5cba5a-e516-4f78-92cb-9f7665610333 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-968eb1f2-0e24-478d-a591-aba70c11103c-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-aef807f0-7492-48d7-aed2-bd0a543854ca-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-aef807f0-7492-48d7-aed2-bd0a543854ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" acquired by "delete_volume" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086cad2-8ced-4707-9db2-10c8f1fa9049]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:14 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:33:14 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:14 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f" returned: 0 in 0.958s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:14 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce 1G Jul 09 01:33:14 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:15 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 1.096s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:15 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca Jul 09 01:33:15 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:15 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce 1G" returned: 0 in 1.062s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ff49da-602b-4868-8b73-10ad7372ac4f -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:15 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ff49da-602b-4868-8b73-10ad7372ac4f -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce Jul 09 01:33:15 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:15 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-aef807f0-7492-48d7-aed2-bd0a543854ca" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-aef807f0-7492-48d7-aed2-bd0a543854ca" released by "delete_volume" :: held 2.019s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Created reservations ['9d90139b-658c-455a-a857-b4baf8724d08', '305731ea-c82e-47c5-bf4e-7bc455a8dc18', '21f84670-4844-416c-ba8c-2be73d3c95b1', '4b23e2f4-2047-4fb7-bafd-2109ac3587e0'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:16 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:16 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:16 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ff49da-602b-4868-8b73-10ad7372ac4f -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce" returned: 0 in 0.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:16 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce is being set with open permissions: ugo+rw Jul 09 01:33:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:16 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce Jul 09 01:33:16 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:17 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Deleted volume successfully. Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-7cc2400b-d7f8-43de-8573-06dc7302bc7d tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-aef807f0-7492-48d7-aed2-bd0a543854ca-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:17 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce" returned: 0 in 0.832s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-10e59719-d13a-46f1-98d0-896dd5684dec-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-10e59719-d13a-46f1-98d0-896dd5684dec-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:17 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info Jul 09 01:33:17 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168b429-6380-4496-957b-3fe5d3d86d12]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:17 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec Jul 09 01:33:17 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:18 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info" returned: 0 in 0.765s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:18 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info is being set with open permissions: ugo+rw Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:18 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info Jul 09 01:33:18 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:18 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec" returned: 0 in 0.932s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:18 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec Jul 09 01:33:18 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (b1e8729b-9007-42d8-9d44-7bebcd47a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d177a911-6866-4d37-bfca-3675e43be0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d177a911-6866-4d37-bfca-3675e43be0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833792742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdbdc3-0414-4fa0-a66b-4bee07e468f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:19Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903339fe-17f4-4d70-9219-e962884d4476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903339fe-17f4-4d70-9219-e962884d4476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:19 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743ea887-5e08-4733-8f4c-6a4d071ad21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743ea887-5e08-4733-8f4c-6a4d071ad21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cdbdc3-0414-4fa0-a66b-4bee07e468f1', 'volume_name': 'volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf7712e-e34f-4009-8c40-13c8eff3ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf7712e-e34f-4009-8c40-13c8eff3ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25383fae-920c-4ecd-a409-3fe7b0c2c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume 60cdbdc3-0414-4fa0-a66b-4bee07e468f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1', 'volume_size': 1} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.info" returned: 0 in 0.876s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.636s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833792742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdbdc3-0414-4fa0-a66b-4bee07e468f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:19Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume 60cdbdc3-0414-4fa0-a66b-4bee07e468f1 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:19 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:19 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 1073741824 Jul 09 01:33:19 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6b35992a-c175-4389-99d4-4dcf960fd913 tempest-CreateVolumesFromSnapshotTest-326939590 None] Create snapshot completed successfully Jul 09 01:33:19 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-10e59719-d13a-46f1-98d0-896dd5684dec" returned: 0 in 0.847s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-quobyte-10e59719-d13a-46f1-98d0-896dd5684dec" released by "delete_volume" :: held 1.840s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Created reservations ['07abf174-d11f-4947-a317-3bdde3ca30bd', 'a0e04c1f-744a-49bd-be0a-7473d258ba00', '933ac8dc-4973-4357-b1c8-d86fb3c14b34', 'ba8d894b-98e6-4b62-a7a8-9c548d75917e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:19 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:19 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:20 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 1073741824" returned: 0 in 1.038s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:20 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 Jul 09 01:33:20 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:20 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.925s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Deleted volume successfully. Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ab076f7a-78f0-4170-867b-38416a0e2079 tempest-VolumeDependencyTests-1122123020 None] Lock "cinder-10e59719-d13a-46f1-98d0-896dd5684dec-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (59105026-6a34-497b-afcd-659eb63cdc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9280f002-6566-41dc-9a19-01f4cbbe2a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9280f002-6566-41dc-9a19-01f4cbbe2a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175125440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3839b402-13e0-4869-98f0-5fc0c4352067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:21Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947ca7c5-c93a-487d-8c87-72a8698979a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947ca7c5-c93a-487d-8c87-72a8698979a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a3102-e68a-4351-b2c7-8b2c9e46ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a3102-e68a-4351-b2c7-8b2c9e46ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3839b402-13e0-4869-98f0-5fc0c4352067', 'volume_name': 'volume-3839b402-13e0-4869-98f0-5fc0c4352067', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d574e0-78f3-4a08-8ed1-b78f9d655c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d574e0-78f3-4a08-8ed1-b78f9d655c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e8fc66-1e5f-4136-8f6f-4a38086876e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume 3839b402-13e0-4869-98f0-5fc0c4352067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3839b402-13e0-4869-98f0-5fc0c4352067', 'volume_size': 1} Jul 09 01:33:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (98836ed3-d5b8-4613-9506-8eb3ddffc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5297f3f4-bd0d-4b0a-8966-46213da49300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5297f3f4-bd0d-4b0a-8966-46213da49300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683203535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d7dd92-b06e-4bd1-b388-0eb6b0881f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:21Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc5c94f-4967-4db8-a2dd-4bf4c06a7fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc5c94f-4967-4db8-a2dd-4bf4c06a7fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be32fbaf-dff4-435f-a79e-2c7fe084b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be32fbaf-dff4-435f-a79e-2c7fe084b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d7dd92-b06e-4bd1-b388-0eb6b0881f23', 'volume_name': 'volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e25b000-4ecb-4cf1-ae97-9c0a321eb8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e25b000-4ecb-4cf1-ae97-9c0a321eb8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33166cea-4332-4504-b77a-ed2af5c7cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume 93d7dd92-b06e-4bd1-b388-0eb6b0881f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23', 'volume_size': 1} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" returned: 0 in 1.081s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175125440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3839b402-13e0-4869-98f0-5fc0c4352067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:21Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume 3839b402-13e0-4869-98f0-5fc0c4352067 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:21 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:21 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 1073741824 Jul 09 01:33:21 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25383fae-920c-4ecd-a409-3fe7b0c2c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ada92-70b5-4c1a-bd8c-60bdafba58db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 (60cdbdc3-0414-4fa0-a66b-4bee07e468f1): created successfully Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ada92-70b5-4c1a-bd8c-60bdafba58db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (b1e8729b-9007-42d8-9d44-7bebcd47a84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c2daa769-f54a-4158-a782-ceae8a9c2ec7 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (0859a7a7-1a73-40f7-ab1e-1960057c7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fc0c47-079f-4197-878c-9437dcb23e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fc0c47-079f-4197-878c-9437dcb23e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809209497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081fa0cf-e7a5-49ba-9adb-f32d44441e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:22Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5271f4-0104-47a9-b4ef-1dc2511ecc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5271f4-0104-47a9-b4ef-1dc2511ecc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8781b7b6-43fa-4e68-8386-f2577ea2c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8781b7b6-43fa-4e68-8386-f2577ea2c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081fa0cf-e7a5-49ba-9adb-f32d44441e59', 'volume_name': 'volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7f9fba-fb19-4527-8838-59821955bbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7f9fba-fb19-4527-8838-59821955bbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff684851-011c-41a9-98e8-825c10a2a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume 081fa0cf-e7a5-49ba-9adb-f32d44441e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59', 'volume_size': 1} Jul 09 01:33:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (44c3422a-e671-4cc5-aede-519c1f57adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbeb33f-364b-4e55-a99d-1f23d6a2d4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbeb33f-364b-4e55-a99d-1f23d6a2d4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477784028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efdcf6b-3654-40e3-ba45-6e0a06bde930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:22Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fa5098-e887-4b10-866d-8d2b61eac282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fa5098-e887-4b10-866d-8d2b61eac282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44518ff8-c3c7-4b79-bd6b-f50c5cb713d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44518ff8-c3c7-4b79-bd6b-f50c5cb713d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efdcf6b-3654-40e3-ba45-6e0a06bde930', 'volume_name': 'volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1062a1e4-b98f-4ae7-bace-fb4570f259d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1062a1e4-b98f-4ae7-bace-fb4570f259d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:22 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db93e4-53d6-4bc2-8f0b-ad1445a9996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume 7efdcf6b-3654-40e3-ba45-6e0a06bde930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930', 'volume_size': 1} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 1073741824" returned: 0 in 1.594s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:22 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 Jul 09 01:33:22 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (75474425-9cfc-4027-b081-df3c43f09516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5b1f76-7385-42fa-8d86-6070398fe324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5b1f76-7385-42fa-8d86-6070398fe324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-401770372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5c6967-9f7b-4dee-8a98-d3b42152a5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:23Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cd0e1a-78de-41c5-b689-dadf6ac6dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cd0e1a-78de-41c5-b689-dadf6ac6dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e8634-8817-492e-9f9c-d033bb623cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e8634-8817-492e-9f9c-d033bb623cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5c6967-9f7b-4dee-8a98-d3b42152a5f5', 'volume_name': 'volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3fa48d-1d7a-4722-8feb-cc3eaf870f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3fa48d-1d7a-4722-8feb-cc3eaf870f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56bf86b-1c1b-4dea-a837-8ecbc196b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume ee5c6967-9f7b-4dee-8a98-d3b42152a5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5', 'volume_size': 1} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (48f9ac36-d87e-4a10-ba6a-ce91c048f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b27840-2056-4708-8660-226092bb0874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b27840-2056-4708-8660-226092bb0874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814708934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc6d37d-b8c9-4ffe-a347-698842a1fdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:23Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0edee0-09eb-4fe4-a6a1-9a62d5b113be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0edee0-09eb-4fe4-a6a1-9a62d5b113be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0391a17c-378d-4080-a44c-97570cd4e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0391a17c-378d-4080-a44c-97570cd4e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc6d37d-b8c9-4ffe-a347-698842a1fdca', 'volume_name': 'volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1014b3-71df-4d98-814b-b57817a60cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1014b3-71df-4d98-814b-b57817a60cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcab4e9c-c5eb-44d7-a890-368e4a479b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume 7dc6d37d-b8c9-4ffe-a347-698842a1fdca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca', 'volume_size': 1} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (f686a7f1-3f84-4ff1-babe-9e803357e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28256cf-850e-44a4-80f0-7fc2a122e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28256cf-850e-44a4-80f0-7fc2a122e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1756152756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907e41de-112a-477e-a705-c67813c23d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:24Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af276bad-0d47-40d0-a94a-eaa2dff5e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af276bad-0d47-40d0-a94a-eaa2dff5e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236905b3-5833-43e7-94c9-94a7c610956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236905b3-5833-43e7-94c9-94a7c610956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907e41de-112a-477e-a705-c67813c23d7b', 'volume_name': 'volume-907e41de-112a-477e-a705-c67813c23d7b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0b599c-a95d-4c21-8e5c-457422b3b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0b599c-a95d-4c21-8e5c-457422b3b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d0a76b-6303-4112-8d28-d3ed58d3dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume 907e41de-112a-477e-a705-c67813c23d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907e41de-112a-477e-a705-c67813c23d7b', 'volume_size': 1} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:23 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067" returned: 0 in 1.042s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (2698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683203535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d7dd92-b06e-4bd1-b388-0eb6b0881f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:21Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume 93d7dd92-b06e-4bd1-b388-0eb6b0881f23 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:23 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:24 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 1073741824 Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e8fc66-1e5f-4136-8f6f-4a38086876e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3839b402-13e0-4869-98f0-5fc0c4352067', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202aa27f-97a2-4e72-a941-1ddeba1a0cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-3839b402-13e0-4869-98f0-5fc0c4352067 (3839b402-13e0-4869-98f0-5fc0c4352067): created successfully Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202aa27f-97a2-4e72-a941-1ddeba1a0cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (59105026-6a34-497b-afcd-659eb63cdc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bdfdf5fe-3650-44c9-a6e3-cf899f3f2a6b tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (b87fad25-05d7-466b-81ca-da15f597dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc71030f-4429-4d38-b763-c72ae7fa9682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc71030f-4429-4d38-b763-c72ae7fa9682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932836259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:24Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a470290-04d7-4ee6-9bd4-fe8512e27c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a470290-04d7-4ee6-9bd4-fe8512e27c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe6ebaf-8d4f-4cdd-87e2-be8934683f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe6ebaf-8d4f-4cdd-87e2-be8934683f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f', 'volume_name': 'volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64846418-babc-4b5f-87f1-1435a7ef2f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64846418-babc-4b5f-87f1-1435a7ef2f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9f7fc-5a95-4f0a-9996-1c6c8efe1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:24 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f', 'volume_size': 1} Jul 09 01:33:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (15a81df5-4e40-44db-a6b6-e199f70bcac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022ba5d4-0044-4292-a970-9dff960d40be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022ba5d4-0044-4292-a970-9dff960d40be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880295866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff5bee6-4421-4433-9e0c-e34a8e996977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:25Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9983396-bc73-4193-8112-3c32254f0bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9983396-bc73-4193-8112-3c32254f0bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd7ee4-d7a5-4729-b8ac-4a2eb2f391da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd7ee4-d7a5-4729-b8ac-4a2eb2f391da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff5bee6-4421-4433-9e0c-e34a8e996977', 'volume_name': 'volume-8ff5bee6-4421-4433-9e0c-e34a8e996977', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a1596a-212a-4129-8855-bf7440f35518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a1596a-212a-4129-8855-bf7440f35518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cf595-c775-4336-8754-5aa410ee1a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume 8ff5bee6-4421-4433-9e0c-e34a8e996977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff5bee6-4421-4433-9e0c-e34a8e996977', 'volume_size': 1} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:25 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 1073741824" returned: 0 in 1.364s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:25 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 Jul 09 01:33:25 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Flow 'volume_create_manager' (460a5460-9aab-4354-85dc-048f165e17bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94afe554-9bee-4d21-8289-67fe86adbc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94afe554-9bee-4d21-8289-67fe86adbc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc38ec93-c52d-4944-953a-d78a9b189fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc7c6ea608d4a4088def91193735315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:26Z,use_quota=True,user_id='2cc126907b644f8a80dab51a009ac31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6bc89c-d102-4c57-ac88-323223c335e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6bc89c-d102-4c57-ac88-323223c335e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f03a2e2-1b86-4071-971e-4c60a0887fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f03a2e2-1b86-4071-971e-4c60a0887fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc38ec93-c52d-4944-953a-d78a9b189fa7', 'volume_name': 'volume-fc38ec93-c52d-4944-953a-d78a9b189fa7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc14b6c-f939-4cd8-bbc1-0069e5c70328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc14b6c-f939-4cd8-bbc1-0069e5c70328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d7f495-27c7-4e2c-94c0-aff0e62a0408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Volume fc38ec93-c52d-4944-953a-d78a9b189fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc38ec93-c52d-4944-953a-d78a9b189fa7', 'volume_size': 1} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (262b7006-ffb0-4ac4-a578-48836297b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d00774-14c3-4480-8af4-df6e4fa09592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d00774-14c3-4480-8af4-df6e4fa09592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57916569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05280a31-32ef-49f4-8144-9826296dd325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:26Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8f2c5a-7a45-4f85-85f0-509a0e20f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8f2c5a-7a45-4f85-85f0-509a0e20f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7e5fba-d732-4b30-86fe-04c10baf1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7e5fba-d732-4b30-86fe-04c10baf1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05280a31-32ef-49f4-8144-9826296dd325', 'volume_name': 'volume-05280a31-32ef-49f4-8144-9826296dd325', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8013a6f9-689f-46a5-b063-e7f6afc5eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8013a6f9-689f-46a5-b063-e7f6afc5eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e0b241-9d48-4d8e-a140-b75077f69261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:25 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume 05280a31-32ef-49f4-8144-9826296dd325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05280a31-32ef-49f4-8144-9826296dd325', 'volume_size': 1} Jul 09 01:33:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:26 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" returned: 0 in 0.749s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.285s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809209497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081fa0cf-e7a5-49ba-9adb-f32d44441e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:22Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume 081fa0cf-e7a5-49ba-9adb-f32d44441e59 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:26 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:26 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 1073741824 Jul 09 01:33:26 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33166cea-4332-4504-b77a-ed2af5c7cb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40804fec-4e77-4328-8860-79abdb8a5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 (93d7dd92-b06e-4bd1-b388-0eb6b0881f23): created successfully Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40804fec-4e77-4328-8860-79abdb8a5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (98836ed3-d5b8-4613-9506-8eb3ddffc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c02063bc-0c02-45af-a8b4-bc6a9c7ca9c0 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:27 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 1073741824" returned: 0 in 0.894s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:27 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 Jul 09 01:33:27 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:27 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59" returned: 0 in 0.725s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.979s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477784028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efdcf6b-3654-40e3-ba45-6e0a06bde930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:22Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume 7efdcf6b-3654-40e3-ba45-6e0a06bde930 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:27 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff684851-011c-41a9-98e8-825c10a2a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:27 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 1073741824 Jul 09 01:33:27 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922df481-dec7-45a2-8c70-cb7e7740666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 (081fa0cf-e7a5-49ba-9adb-f32d44441e59): created successfully Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922df481-dec7-45a2-8c70-cb7e7740666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (0859a7a7-1a73-40f7-ab1e-1960057c7577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:27 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1032bd3a-75d6-4aff-b6cf-9acb01e4443c tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:28 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 1073741824" returned: 0 in 0.957s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:28 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 Jul 09 01:33:28 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:29 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930" returned: 0 in 0.681s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.322s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-401770372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5c6967-9f7b-4dee-8a98-d3b42152a5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38b0a9f825c4cc6bb46264f08d34c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:23Z,use_quota=True,user_id='b113001859b149cb9108fdd68e025f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Creating volume ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:29 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db93e4-53d6-4bc2-8f0b-ad1445a9996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c5061-5422-424d-90e0-15b4b779c9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:29 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 1073741824 Jul 09 01:33:29 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:29 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 (7efdcf6b-3654-40e3-ba45-6e0a06bde930): created successfully Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c5061-5422-424d-90e0-15b4b779c9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:29 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (44c3422a-e671-4cc5-aede-519c1f57adef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:29 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b55c1c52-4998-4656-9e5e-dbf47ed84df6 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:30 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 1073741824" returned: 0 in 1.004s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:30 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 Jul 09 01:33:30 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:31 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.931s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814708934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc6d37d-b8c9-4ffe-a347-698842a1fdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:23Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume 7dc6d37d-b8c9-4ffe-a347-698842a1fdca {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:31 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56bf86b-1c1b-4dea-a837-8ecbc196b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:31 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca 1073741824 Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20705b4c-bb2f-45c9-b0d8-a3a400b33aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:31 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:31 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Volume volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 (ee5c6967-9f7b-4dee-8a98-d3b42152a5f5): created successfully Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20705b4c-bb2f-45c9-b0d8-a3a400b33aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:31 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Flow 'volume_create_manager' (75474425-9cfc-4027-b081-df3c43f09516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ceb5bd2f-f5f3-4952-b087-210f536f9efa tempest-CreateVolumesFromSnapshotTest-326939590 None] Created volume successfully. Jul 09 01:33:32 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca 1073741824" returned: 0 in 0.930s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:32 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca Jul 09 01:33:32 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce1900-6de3-4ee7-b54c-4695dd752b1b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:32 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 Jul 09 01:33:32 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:33 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" returned: 0 in 0.780s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.164s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1756152756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907e41de-112a-477e-a705-c67813c23d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:24Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume 907e41de-112a-477e-a705-c67813c23d7b {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:33 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcab4e9c-c5eb-44d7-a890-368e4a479b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25202f38-2698-4a01-b121-a33e6c0a22fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:33 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b 1073741824 Jul 09 01:33:33 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:33 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca (7dc6d37d-b8c9-4ffe-a347-698842a1fdca): created successfully Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25202f38-2698-4a01-b121-a33e6c0a22fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (48f9ac36-d87e-4a10-ba6a-ce91c048f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:33 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0e638131-1408-400f-9250-a90497b8904d tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:33 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" returned: 0 in 0.898s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:33 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5 Jul 09 01:33:33 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:33:33 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:33:34 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b 1073741824" returned: 0 in 1.149s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:34 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" returned: 0 in 0.966s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5" released by "delete_volume" :: held 1.926s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:34 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b Jul 09 01:33:34 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['cfbad670-2b40-45af-b653-a321b251b964', '80da1d41-1b8a-4656-98ce-c07ed9b5720f', '22189364-a442-4334-8426-8b129a63a7b2', '270b79bb-15f6-4184-a9db-1bf75003070d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:34 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:34 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-7efdcf6b-3654-40e3-ba45-6e0a06bde930-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-7efdcf6b-3654-40e3-ba45-6e0a06bde930-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-7efdcf6b-3654-40e3-ba45-6e0a06bde930" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-7efdcf6b-3654-40e3-ba45-6e0a06bde930" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4893f2d-d41b-4fdb-a17d-1462b27e0a87]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:34 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 Jul 09 01:33:34 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:35 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b" returned: 0 in 0.947s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.739s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932836259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:24Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:35 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:35 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f 1073741824 Jul 09 01:33:35 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d0a76b-6303-4112-8d28-d3ed58d3dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907e41de-112a-477e-a705-c67813c23d7b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57d6230-1c26-4c66-aba3-9ded24697963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-907e41de-112a-477e-a705-c67813c23d7b (907e41de-112a-477e-a705-c67813c23d7b): created successfully Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57d6230-1c26-4c66-aba3-9ded24697963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (f686a7f1-3f84-4ff1-babe-9e803357e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8e9241dc-82d4-4ced-880c-7bb1d933d224 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:35 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.952s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-03c94e0a-0dab-47a0-aeb3-69c603a877a4 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-ee5c6967-9f7b-4dee-8a98-d3b42152a5f5-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:35 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930" returned: 0 in 0.926s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:35 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930 Jul 09 01:33:35 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:36 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f 1073741824" returned: 0 in 1.163s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=144,cinder:SELECT=98,cinder:DELETE=15,cinder:INSERT=37 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:36 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f Jul 09 01:33:36 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:36 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7efdcf6b-3654-40e3-ba45-6e0a06bde930" returned: 0 in 0.864s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-7efdcf6b-3654-40e3-ba45-6e0a06bde930" released by "delete_volume" :: held 1.848s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=111,cinder:INSERT=32,cinder:UPDATE=127,cinder:DELETE=13 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['73ea54d9-a318-46f5-bedf-bfb09e77f61a', '6ddf6d50-5538-4e1b-a680-b1e52691d639', '36abbbbb-841d-4ce9-818a-c08613312f1b', '004ceb11-b41f-4b1e-a487-0ef39defdb35'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:36 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:36 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-081fa0cf-e7a5-49ba-9adb-f32d44441e59-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:36 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-081fa0cf-e7a5-49ba-9adb-f32d44441e59-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-081fa0cf-e7a5-49ba-9adb-f32d44441e59" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-081fa0cf-e7a5-49ba-9adb-f32d44441e59" acquired by "delete_volume" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a20ce7-f2b6-4cea-91ad-d8521ec00608]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:37 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 Jul 09 01:33:37 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:37 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" returned: 0 in 0.791s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.088s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880295866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff5bee6-4421-4433-9e0c-e34a8e996977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:25Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume 8ff5bee6-4421-4433-9e0c-e34a8e996977 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:37 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:37 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 1073741824 Jul 09 01:33:37 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9f7fc-5a95-4f0a-9996-1c6c8efe1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff11bb1b-4c2a-4b5e-b639-4f49d3f3ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f (fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f): created successfully Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff11bb1b-4c2a-4b5e-b639-4f49d3f3ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (b87fad25-05d7-466b-81ca-da15f597dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-baf16eaf-6c10-4e93-8245-d350263ef976 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:37 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.853s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8eb62baf-da5d-43ee-baef-a7c02521d696 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-7efdcf6b-3654-40e3-ba45-6e0a06bde930-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:38 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59" returned: 0 in 0.928s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:38 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59 Jul 09 01:33:38 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:38 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 1073741824" returned: 0 in 1.114s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:38 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 Jul 09 01:33:38 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:38 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-081fa0cf-e7a5-49ba-9adb-f32d44441e59" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-081fa0cf-e7a5-49ba-9adb-f32d44441e59" released by "delete_volume" :: held 1.809s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['88833833-ec8d-4fff-a326-0f25e4255b64', 'fbf41861-49db-412b-8b86-be36b907bed0', '472ecade-54a8-4aed-9eb2-c99f337a603b', '0c9d5d54-5277-4209-9d0c-8b90e5788686'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:39 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:39 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:39 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977" returned: 0 in 0.794s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.478s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc38ec93-c52d-4944-953a-d78a9b189fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc7c6ea608d4a4088def91193735315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:26Z,use_quota=True,user_id='2cc126907b644f8a80dab51a009ac31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Creating volume fc38ec93-c52d-4944-953a-d78a9b189fa7 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:39 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-93d7dd92-b06e-4bd1-b388-0eb6b0881f23-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:39 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 1073741824 Jul 09 01:33:39 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cf595-c775-4336-8754-5aa410ee1a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff5bee6-4421-4433-9e0c-e34a8e996977', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc6daf9-a3c6-4d01-8dfe-359e2873a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-93d7dd92-b06e-4bd1-b388-0eb6b0881f23-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 (8ff5bee6-4421-4433-9e0c-e34a8e996977): created successfully Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc6daf9-a3c6-4d01-8dfe-359e2873a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (15a81df5-4e40-44db-a6b6-e199f70bcac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b67b9a93-9dbc-4917-a6d7-09fad060c32a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e16e82-7ac7-4ffb-b672-fabba8e302bb]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:39 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 Jul 09 01:33:39 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:39 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.858s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a167b66c-1965-4dd2-81e5-8a9030439b89 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-081fa0cf-e7a5-49ba-9adb-f32d44441e59-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:40 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 1073741824" returned: 0 in 1.081s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:40 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 Jul 09 01:33:40 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:40 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" returned: 0 in 0.982s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:40 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23 Jul 09 01:33:40 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:41 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7" returned: 0 in 0.759s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.303s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57916569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05280a31-32ef-49f4-8144-9826296dd325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c1206820cb47cf8b4985f20922d365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:26Z,use_quota=True,user_id='59ae4969bdbc4a30a0213485a5f150a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Creating volume 05280a31-32ef-49f4-8144-9826296dd325 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:41 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:41 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:41 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 1073741824 Jul 09 01:33:41 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d7f495-27c7-4e2c-94c0-aff0e62a0408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc38ec93-c52d-4944-953a-d78a9b189fa7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d240b60-a0fe-417a-b717-9a7427eeab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-93d7dd92-b06e-4bd1-b388-0eb6b0881f23" released by "delete_volume" :: held 1.804s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Volume volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 (fc38ec93-c52d-4944-953a-d78a9b189fa7): created successfully Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d240b60-a0fe-417a-b717-9a7427eeab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Flow 'volume_create_manager' (460a5460-9aab-4354-85dc-048f165e17bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:41 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2e34db9b-cda5-44a0-89a1-1b70c0a62c19 tempest-CinderUnicodeTest-819579329 None] Created volume successfully. Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['2c35cc88-9f16-4a1f-9637-ee46755061ba', '521600e1-9bdd-4d73-808e-039fb740a9b0', '79b78945-9dbf-4a9a-8308-00e2bc299bd0', '217840af-79a2-4b4b-8ce1-d48198683fe5'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:41 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:41 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-3839b402-13e0-4869-98f0-5fc0c4352067-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-3839b402-13e0-4869-98f0-5fc0c4352067-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-3839b402-13e0-4869-98f0-5fc0c4352067" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-3839b402-13e0-4869-98f0-5fc0c4352067" acquired by "delete_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a4c2f-6ba7-442b-9fe6-5838aa4fc84f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:42 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 Jul 09 01:33:42 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Flow 'volume_create_manager' (387f9f8b-bee4-4644-8f3d-42407ff52dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf447dc5-707f-4d5c-8c96-12abf2f36683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf447dc5-707f-4d5c-8c96-12abf2f36683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-882628505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608943af-250a-418a-b32b-a8f106634666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc7c6ea608d4a4088def91193735315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:42Z,use_quota=True,user_id='2cc126907b644f8a80dab51a009ac31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef96f4e8-faf2-43fd-b51b-6252e80339f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef96f4e8-faf2-43fd-b51b-6252e80339f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f248f-8ce1-425d-838b-17389082c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:42 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f248f-8ce1-425d-838b-17389082c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608943af-250a-418a-b32b-a8f106634666', 'volume_name': 'volume-608943af-250a-418a-b32b-a8f106634666', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e2ccd8-00f8-4fc1-b874-4fe377d2aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e2ccd8-00f8-4fc1-b874-4fe377d2aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7f76e2-8cb4-47da-8fe2-f5f5707a4f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Volume 608943af-250a-418a-b32b-a8f106634666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608943af-250a-418a-b32b-a8f106634666', 'volume_size': 1} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.121s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b6b9529e-b851-4b75-be19-ee84a252d971 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-93d7dd92-b06e-4bd1-b388-0eb6b0881f23-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:42 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 1073741824" returned: 0 in 1.485s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:42 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 Jul 09 01:33:42 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:42 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067" returned: 0 in 1.033s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:42 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067 Jul 09 01:33:42 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:43 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325" returned: 0 in 0.899s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-882628505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608943af-250a-418a-b32b-a8f106634666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc7c6ea608d4a4088def91193735315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:42Z,use_quota=True,user_id='2cc126907b644f8a80dab51a009ac31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Creating volume 608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:43 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:43 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 1073741824 Jul 09 01:33:43 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e0b241-9d48-4d8e-a140-b75077f69261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05280a31-32ef-49f4-8144-9826296dd325', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a8fd1-6ef6-49cf-b854-76e724862de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Volume volume-05280a31-32ef-49f4-8144-9826296dd325 (05280a31-32ef-49f4-8144-9826296dd325): created successfully Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a8fd1-6ef6-49cf-b854-76e724862de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Flow 'volume_create_manager' (262b7006-ffb0-4ac4-a578-48836297b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ec9d77d5-30cb-40c8-81c2-4efea80b6fbf tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created volume successfully. Jul 09 01:33:43 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-3839b402-13e0-4869-98f0-5fc0c4352067" returned: 0 in 0.915s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-3839b402-13e0-4869-98f0-5fc0c4352067" released by "delete_volume" :: held 2.018s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:43 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['9f916f63-f3ec-4089-a21c-6102167bbbfa', '83b88995-17f8-4352-9e7e-80f9f0e82a0e', 'fb4f332d-c1a6-4916-8524-b6e97c4b7505', '7289b57c-dc1b-4d78-842b-cdaa0622fb7f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:44 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:44 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-05280a31-32ef-49f4-8144-9826296dd325-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-05280a31-32ef-49f4-8144-9826296dd325-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-05280a31-32ef-49f4-8144-9826296dd325" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-05280a31-32ef-49f4-8144-9826296dd325" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c7fd2-1591-45e5-a8fb-ae108822a3af]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:44 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 1073741824" returned: 0 in 1.014s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:44 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 Jul 09 01:33:44 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:44 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 Jul 09 01:33:44 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:45 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.000s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b5b4944b-04d4-461b-8458-3c48c7f3aa8f tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-3839b402-13e0-4869-98f0-5fc0c4352067-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-7dc10916-0b14-4f43-b1bf-fe70da0e43ce-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-7dc10916-0b14-4f43-b1bf-fe70da0e43ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-7dc10916-0b14-4f43-b1bf-fe70da0e43ce" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-7dc10916-0b14-4f43-b1bf-fe70da0e43ce" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleting offline snapshot 7dc10916-0b14-4f43-b1bf-fe70da0e43ce of volume 31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] snapshot_file for this snap is: volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f0c02-66ad-4460-bba9-52337bb77e12]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:45 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce Jul 09 01:33:45 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:45 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666" returned: 0 in 0.893s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7f76e2-8cb4-47da-8fe2-f5f5707a4f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608943af-250a-418a-b32b-a8f106634666', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fcfaca-e4ec-4e45-b39a-9830e003b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:45 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Volume volume-608943af-250a-418a-b32b-a8f106634666 (608943af-250a-418a-b32b-a8f106634666): created successfully Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fcfaca-e4ec-4e45-b39a-9830e003b845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Flow 'volume_create_manager' (387f9f8b-bee4-4644-8f3d-42407ff52dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:45 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f41df02b-ba35-451f-9169-1cfc54b0b960 tempest-CinderUnicodeTest-819579329 None] Created volume successfully. Jul 09 01:33:45 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325" returned: 0 in 1.177s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:45 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325 Jul 09 01:33:45 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:46 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce" returned: 0 in 1.038s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31ff49da-602b-4868-8b73-10ad7372ac4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eacca6-1fc1-4010-8492-8297465dabd2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:46 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-05280a31-32ef-49f4-8144-9826296dd325" returned: 0 in 0.751s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-05280a31-32ef-49f4-8144-9826296dd325" released by "delete_volume" :: held 1.992s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:46 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f Jul 09 01:33:46 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['95e52fdc-7e9b-4350-a0df-58ac53d98502', 'bea76986-6856-481f-8553-adf23132896b', '1b1cb637-d174-47fe-8056-1ca628e68d8f', '517ef76b-9444-498f-89c7-dea7f15ce4f8'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:46 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:46 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Creating offline snapshot 80771b4e-8460-4360-904c-c9959d3bec25 of volume 608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cec672-7098-437a-b944-a0ab15297b7a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:47 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f" returned: 0 in 1.063s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:47 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce Jul 09 01:33:47 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:47 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 Jul 09 01:33:47 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:47 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:47 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-93294098-0f47-4892-950c-ff275319aaeb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-05280a31-32ef-49f4-8144-9826296dd325-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-8ff5bee6-4421-4433-9e0c-e34a8e996977-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-8ff5bee6-4421-4433-9e0c-e34a8e996977-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-8ff5bee6-4421-4433-9e0c-e34a8e996977" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-8ff5bee6-4421-4433-9e0c-e34a8e996977" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c050e0bc-17c9-44c8-b021-5e0f9c4b8b3f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:48 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 Jul 09 01:33:48 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:48 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666" returned: 0 in 1.041s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:48 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 1G Jul 09 01:33:48 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:48 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce" returned: 0 in 1.120s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:48 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce Jul 09 01:33:48 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:49 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977" returned: 0 in 1.134s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:49 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977 Jul 09 01:33:49 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:49 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 1G" returned: 0 in 1.245s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608943af-250a-418a-b32b-a8f106634666 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:49 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f.7dc10916-0b14-4f43-b1bf-fe70da0e43ce" returned: 0 in 1.106s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:49 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608943af-250a-418a-b32b-a8f106634666 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 Jul 09 01:33:49 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-7dc10916-0b14-4f43-b1bf-fe70da0e43ce" released by "_delete_snapshot" :: held 4.496s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" released by "delete_snapshot" :: held 4.538s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['4484b35d-4445-4da4-ac45-70e60172af5e', '24a2af6c-1309-4458-92fb-3628947710ce', 'b2ec55bb-fdd4-4c53-b046-d89cc4c8c207', '9de7bcff-a767-4a3b-b234-d8578e5ef978'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Delete snapshot completed successfully. Jul 09 01:33:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f3103d51-cb12-4d32-b068-89b993ab52ac tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-7dc10916-0b14-4f43-b1bf-fe70da0e43ce-delete_snapshot" released by "delete_snapshot" :: held 4.747s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:50 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-8ff5bee6-4421-4433-9e0c-e34a8e996977" returned: 0 in 0.947s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-8ff5bee6-4421-4433-9e0c-e34a8e996977" released by "delete_volume" :: held 2.139s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['8183e1b1-dfa8-404e-9e47-49151d5ba34e', '169bfc28-3529-4aea-8a22-114f59d44995', 'f64f4943-49fa-4c67-837a-2920acbb0797', 'c60e24cc-aff3-4441-8053-02a1322d7baf'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:50 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:50 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:50 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608943af-250a-418a-b32b-a8f106634666 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:50 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 is being set with open permissions: ugo+rw Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:50 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 Jul 09 01:33:50 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Flow 'volume_create_manager' (1fdbad08-65fa-4071-bd0a-aad39b825643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95a4928-5767-452e-bb85-965d316af37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-31ff49da-602b-4868-8b73-10ad7372ac4f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95a4928-5767-452e-bb85-965d316af37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-16346962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225411ad-8943-4250-bb88-d5b92d655bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c270e6f0d8b472f95ea9d3d07fc9462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:50Z,use_quota=True,user_id='fff8e062de6c4ab4afe06c45b698976c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5b0413-2e0f-4eb1-bc3e-871eafe67995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5b0413-2e0f-4eb1-bc3e-871eafe67995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f77642f-2575-4fe9-a5fd-a341ba9f9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f77642f-2575-4fe9-a5fd-a341ba9f9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225411ad-8943-4250-bb88-d5b92d655bb0', 'volume_name': 'volume-225411ad-8943-4250-bb88-d5b92d655bb0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c4aee5-e20e-44ed-b7e5-ae5de97563e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c4aee5-e20e-44ed-b7e5-ae5de97563e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00539e1d-f00b-432c-b20d-a869eb19a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:50 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Volume 225411ad-8943-4250-bb88-d5b92d655bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225411ad-8943-4250-bb88-d5b92d655bb0', 'volume_size': 1} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-31ff49da-602b-4868-8b73-10ad7372ac4f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea21ebb-656b-4444-9043-7b3b2940acb2]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:50 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f Jul 09 01:33:50 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:50 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.769s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:50 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b9c40b15-f3b3-4618-ab02-aa5e8c34af0a tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-8ff5bee6-4421-4433-9e0c-e34a8e996977-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[060efbc6-eac2-466b-a86a-a035403dd5a7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:51 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:51 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info Jul 09 01:33:51 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:51 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f Jul 09 01:33:51 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:51 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f" returned: 0 in 0.836s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:51 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f Jul 09 01:33:51 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:52 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info" returned: 0 in 0.728s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:52 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info is being set with open permissions: ugo+rw Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:52 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" returned: 0 in 0.826s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:52 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info Jul 09 01:33:52 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:52 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f Jul 09 01:33:52 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:52 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-31ff49da-602b-4868-8b73-10ad7372ac4f" returned: 0 in 0.752s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-quobyte-31ff49da-602b-4868-8b73-10ad7372ac4f" released by "delete_volume" :: held 1.655s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Created reservations ['c1c9425c-512f-4bc5-bdb0-ac9f42dacffe', '92df735d-d5ea-4cff-8513-aa3f7968bc0c', 'e29c4468-1b1a-4904-8730-653b6ad39900', 'ddf5b089-2ba9-4402-938e-e7c66b55fc1e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:52 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:52 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:52 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.info" returned: 0 in 0.750s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.569s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-16346962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225411ad-8943-4250-bb88-d5b92d655bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c270e6f0d8b472f95ea9d3d07fc9462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:50Z,use_quota=True,user_id='fff8e062de6c4ab4afe06c45b698976c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Creating volume 225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:33:52 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:33:52 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" returned: 0 in 0.800s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:52 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 1073741824 Jul 09 01:33:52 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f" released by "delete_volume" :: held 1.682s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-925842de-eb2d-47d3-b887-b87c69180cba tempest-CinderUnicodeTest-819579329 None] Create snapshot completed successfully Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['9d76eaea-5a8b-4ec7-9aee-cc9bd1991188', '49d65a8f-26f5-4d3c-8c75-c668c151f690', '26dc7ca9-f1ad-4386-aa98-7b695e0ce0d8', 'fb3172cc-10a0-4b1e-a4e2-0c939f3a4dbe'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:53 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:53 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:53 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Deleted volume successfully. Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bb59c01a-69be-4ae4-8053-09ff35052705 tempest-CreateVolumesFromSnapshotTest-326939590 None] Lock "cinder-31ff49da-602b-4868-8b73-10ad7372ac4f-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-907e41de-112a-477e-a705-c67813c23d7b-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-907e41de-112a-477e-a705-c67813c23d7b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-907e41de-112a-477e-a705-c67813c23d7b" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-907e41de-112a-477e-a705-c67813c23d7b" acquired by "delete_volume" :: waited 0.044s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5077e2e6-c9e1-49b4-adff-7bc8801f4650]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-80771b4e-8460-4360-904c-c9959d3bec25-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-80771b4e-8460-4360-904c-c9959d3bec25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:53 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b Jul 09 01:33:53 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-quobyte-80771b4e-8460-4360-904c-c9959d3bec25" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-80771b4e-8460-4360-904c-c9959d3bec25" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Deleting offline snapshot 80771b4e-8460-4360-904c-c9959d3bec25 of volume 608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] snapshot_file for this snap is: volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[635baa10-e124-4469-b65e-58723620eeb8]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:54 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.970s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:33:54 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 Jul 09 01:33:54 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:54 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e41fbb9d-427c-4688-a035-fa4fa7dbfd07 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-fd08ffd3-a77d-4d01-bc9a-4c94a3ef755f-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 1073741824" returned: 0 in 1.241s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:54 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:33:54 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:54 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b" returned: 0 in 1.052s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:54 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b Jul 09 01:33:54 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:54 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25" returned: 0 in 1.041s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-608943af-250a-418a-b32b-a8f106634666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cac699-28d2-49de-aa48-9055a3cec6b4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:55 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 0.854s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00539e1d-f00b-432c-b20d-a869eb19a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225411ad-8943-4250-bb88-d5b92d655bb0', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f68efb-0d44-4d97-bfa3-5632bfacfcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:55 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Volume volume-225411ad-8943-4250-bb88-d5b92d655bb0 (225411ad-8943-4250-bb88-d5b92d655bb0): created successfully Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f68efb-0d44-4d97-bfa3-5632bfacfcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Flow 'volume_create_manager' (1fdbad08-65fa-4071-bd0a-aad39b825643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:55 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 Jul 09 01:33:55 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0d749430-886c-4f47-8fa8-a28e98f82341 tempest-SnapshotDependencyTests-614544634 None] Created volume successfully. Jul 09 01:33:55 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-907e41de-112a-477e-a705-c67813c23d7b" returned: 0 in 0.842s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-907e41de-112a-477e-a705-c67813c23d7b" released by "delete_volume" :: held 1.965s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['f0fafeb0-c1db-4a97-bacc-c663e199c490', '7af07b6f-f818-4114-8d5f-caffb7f3147d', '12e2ba37-fbde-4e65-9ab2-167535c0db10', '721f8a57-4825-4d46-85f8-71462fdea2ac'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:55 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:55 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-7dc6d37d-b8c9-4ffe-a347-698842a1fdca-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-7dc6d37d-b8c9-4ffe-a347-698842a1fdca-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" acquired by "delete_volume" :: waited 0.032s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1b9de-2126-4660-8bbe-a45f19d14835]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:56 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666" returned: 0 in 1.072s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:56 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 Jul 09 01:33:56 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:56 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca Jul 09 01:33:56 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Creating offline snapshot b3d17a37-5d22-4a43-97e6-8681debce487 of volume 225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f968c-46ab-4048-8bd1-e5dd93015775]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:56 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:56 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.934s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:56 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:33:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-18d0ba37-1090-435b-aba4-c9545fe389fb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-907e41de-112a-477e-a705-c67813c23d7b-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:57 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:57 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" returned: 0 in 1.126s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25" returned: 0 in 1.094s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:57 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca Jul 09 01:33:57 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:57 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25 Jul 09 01:33:57 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:57 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 0.950s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:57 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 1G Jul 09 01:33:57 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (233bc793-b6a9-4d58-8162-c265c09b202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8370b3-2620-4a48-a983-c9bd75513fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:57 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8370b3-2620-4a48-a983-c9bd75513fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548126758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f7bb2-a36f-4822-8f94-0303f559348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:58Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4805c2c7-51dc-405e-910b-bc07d7e50613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4805c2c7-51dc-405e-910b-bc07d7e50613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689e9c4-9112-487d-8a48-e31a1934cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689e9c4-9112-487d-8a48-e31a1934cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0f7bb2-a36f-4822-8f94-0303f559348c', 'volume_name': 'volume-dc0f7bb2-a36f-4822-8f94-0303f559348c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea22592-0177-431e-9dc5-3bb050cf7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea22592-0177-431e-9dc5-3bb050cf7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c6d9a4-3176-47c2-95a0-4f07904cdf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:33:57 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:57 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Volume dc0f7bb2-a36f-4822-8f94-0303f559348c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0f7bb2-a36f-4822-8f94-0303f559348c', 'volume_size': 1} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666.80771b4e-8460-4360-904c-c9959d3bec25" returned: 0 in 0.798s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" returned: 0 in 0.813s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-7dc6d37d-b8c9-4ffe-a347-698842a1fdca" released by "delete_volume" :: held 2.029s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-80771b4e-8460-4360-904c-c9959d3bec25" released by "_delete_snapshot" :: held 4.139s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" released by "delete_snapshot" :: held 4.173s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['5bfd3ee2-a593-4295-89ab-698a2d78f5a2', '3c7ba4de-8e1f-4cf0-9f4b-265635c1f692', 'c9aeed22-a65c-46fa-a2e7-7c69dbd42db1', '637ff67f-8216-4015-a54a-e8d15c5ad055'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Created reservations ['91090d81-f32b-435e-b4a8-093516e797cf', '1d5f1a25-4f17-4b27-b1d8-7d3c306eab0d', '543354e7-bbe4-4635-a639-e17b5ab9cc19', '7bb2f452-d22c-4c37-96f8-85d492a15cce'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:58 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:33:58 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Delete snapshot completed successfully. Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f850b782-4000-4289-a165-7e5b3a1a2d1e tempest-CinderUnicodeTest-819579329 None] Lock "cinder-80771b4e-8460-4360-904c-c9959d3bec25-delete_snapshot" released by "delete_snapshot" :: held 4.421s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:58 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 1G" returned: 0 in 1.016s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225411ad-8943-4250-bb88-d5b92d655bb0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:58 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225411ad-8943-4250-bb88-d5b92d655bb0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:33:58 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:58 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:33:58 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:33:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-adccea08-b9b9-4046-b037-412d44d73ebb tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-7dc6d37d-b8c9-4ffe-a347-698842a1fdca-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-608943af-250a-418a-b32b-a8f106634666-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:59 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225411ad-8943-4250-bb88-d5b92d655bb0 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:59 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 is being set with open permissions: ugo+rw Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "cinder-608943af-250a-418a-b32b-a8f106634666-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-60cdbdc3-0414-4fa0-a66b-4bee07e468f1-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:59 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:33:59 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-60cdbdc3-0414-4fa0-a66b-4bee07e468f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "cinder-quobyte-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[190c834b-1b10-467f-88c4-534c864b9b55]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" acquired by "delete_volume" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49871f-c41f-45c3-85d5-1d58ea435e87]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:33:59 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 Jul 09 01:33:59 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:59 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 Jul 09 01:33:59 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:33:59 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:33:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:00 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info Jul 09 01:34:00 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:00 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666" returned: 0 in 0.834s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:00 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666 Jul 09 01:34:00 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:00 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" returned: 0 in 0.881s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:00 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1 Jul 09 01:34:00 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:00 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:00 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info is being set with open permissions: ugo+rw Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:00 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info Jul 09 01:34:00 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:00 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-608943af-250a-418a-b32b-a8f106634666" returned: 0 in 0.679s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-608943af-250a-418a-b32b-a8f106634666" released by "delete_volume" :: held 1.585s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:00 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Created reservations ['24673bf1-2058-4b79-951f-f0f0277b7333', 'd62c71e2-9dc6-44d3-aa13-edcc2d6c701b', 'b254c08e-22f3-4513-94bc-4a6d7b795605', '0986984b-8663-46f6-9a85-b8532d0fd6b5'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:01 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" returned: 0 in 0.792s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-quobyte-60cdbdc3-0414-4fa0-a66b-4bee07e468f1" released by "delete_volume" :: held 1.721s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:01 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:01 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Created reservations ['6a09e6d2-bef9-40bb-8129-f7ffe20f9c66', 'e759bb2a-29e5-43b9-a368-d4e80c091250', '93411e4b-7df4-49fc-b8e2-c16e7e42fc8d', 'b4be2c0c-0730-4f5c-aa84-c002effc85f2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:01 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:01 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-fc38ec93-c52d-4944-953a-d78a9b189fa7-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:01 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.info" returned: 0 in 0.757s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.048s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548126758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f7bb2-a36f-4822-8f94-0303f559348c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:33:58Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Creating volume dc0f7bb2-a36f-4822-8f94-0303f559348c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:01 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "cinder-fc38ec93-c52d-4944-953a-d78a9b189fa7-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:01 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c 1073741824 Jul 09 01:34:01 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:01 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8b3a4472-80ab-4171-bc08-fd4e1fc72db1 tempest-SnapshotDependencyTests-614544634 None] Create snapshot completed successfully Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Acquiring lock "cinder-quobyte-fc38ec93-c52d-4944-953a-d78a9b189fa7" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-fc38ec93-c52d-4944-953a-d78a9b189fa7" acquired by "delete_volume" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6359aa8-01af-4f7e-bb90-860e9fe470af]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:01 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 Jul 09 01:34:01 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:02 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.924s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Deleted volume successfully. Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b45ac12d-12fd-4d96-829d-10e32f0047cf tempest-CinderUnicodeTest-819579329 None] Lock "cinder-608943af-250a-418a-b32b-a8f106634666-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:02 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.947s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:02 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Deleted volume successfully. Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f2106a2f-372f-4e3e-b76b-5480510cfe30 tempest-CreateVolumesFromSourceVolumeTest-262180883 None] Lock "cinder-60cdbdc3-0414-4fa0-a66b-4bee07e468f1-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:02 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c 1073741824" returned: 0 in 1.193s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:02 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c Jul 09 01:34:02 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:02 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7" returned: 0 in 1.098s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:02 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7 Jul 09 01:34:02 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Flow 'volume_create_manager' (17585b79-ff65-4ca5-b763-7155993166f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eecf3d2-4aa3-4ce9-8383-d4a7fedae50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c" returned: 0 in 0.966s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eecf3d2-4aa3-4ce9-8383-d4a7fedae50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691ba455-b609-4836-9219-b353fbde80b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c270e6f0d8b472f95ea9d3d07fc9462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3d17a37-5d22-4a43-97e6-8681debce487,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:04Z,use_quota=True,user_id='fff8e062de6c4ab4afe06c45b698976c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6768461-adb4-4f27-afc1-2838008c6704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6768461-adb4-4f27-afc1-2838008c6704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedc402f-20f5-4b02-a3c5-3a644c5782b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedc402f-20f5-4b02-a3c5-3a644c5782b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '691ba455-b609-4836-9219-b353fbde80b8', 'volume_name': 'volume-691ba455-b609-4836-9219-b353fbde80b8', 'volume_size': 1, 'snapshot_id': 'b3d17a37-5d22-4a43-97e6-8681debce487'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029755dc-b7a3-44e9-9562-07a35644a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029755dc-b7a3-44e9-9562-07a35644a17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368d9e52-d797-42c4-a2ca-f115b7f1c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Volume 691ba455-b609-4836-9219-b353fbde80b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-691ba455-b609-4836-9219-b353fbde80b8', 'volume_size': 1, 'snapshot_id': 'b3d17a37-5d22-4a43-97e6-8681debce487'} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-fc38ec93-c52d-4944-953a-d78a9b189fa7" returned: 0 in 0.939s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487-691ba455-b609-4836-9219-b353fbde80b8" by "_create_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "cinder-quobyte-fc38ec93-c52d-4944-953a-d78a9b189fa7" released by "delete_volume" :: held 2.111s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c6d9a4-3176-47c2-95a0-4f07904cdf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0f7bb2-a36f-4822-8f94-0303f559348c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8e4aa8-aa2f-4a00-8afe-d3dd83b98a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487-691ba455-b609-4836-9219-b353fbde80b8" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Creating volume 691ba455-b609-4836-9219-b353fbde80b8 from snapshot b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" by "_copy_volume_from_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:03 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Volume volume-dc0f7bb2-a36f-4822-8f94-0303f559348c (dc0f7bb2-a36f-4822-8f94-0303f559348c): created successfully Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8e4aa8-aa2f-4a00-8afe-d3dd83b98a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (233bc793-b6a9-4d58-8162-c265c09b202c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] snapshot: b3d17a37-5d22-4a43-97e6-8681debce487, volume: 691ba455-b609-4836-9219-b353fbde80b8, {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 01:34:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d5b9fcbc-75bf-44c7-ac18-5a61e72a50e6 tempest-ProjectReaderTests-936592836 None] Created volume successfully. Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e5088-c78d-486b-a00f-5c6d8adc1dad]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Created reservations ['4a609617-e11f-4ea9-8ff6-e2c13ddff603', 'f1ce51b2-9e11-421d-844e-a93e492ebe93', '1f5715d6-ceea-40a7-b10e-f85394e73c6c', '6b8733b4-f60d-4735-836d-6a2a16676dda'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:04 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:34:04 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:04 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:04 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-dc0f7bb2-a36f-4822-8f94-0303f559348c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "cinder-dc0f7bb2-a36f-4822-8f94-0303f559348c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-quobyte-dc0f7bb2-a36f-4822-8f94-0303f559348c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-dc0f7bb2-a36f-4822-8f94-0303f559348c" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f762df-6ac6-48a8-84f6-a44527378e84]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:04 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Deleted volume successfully. Jul 09 01:34:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0083ebc3-71e1-4ef6-b644-e82e351e719d tempest-CinderUnicodeTest-819579329 None] Lock "cinder-fc38ec93-c52d-4944-953a-d78a9b189fa7-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:05 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c Jul 09 01:34:05 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:05 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 1.067s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225411ad-8943-4250-bb88-d5b92d655bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Creating direct copy from snapshot {{(pid=86954) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f3f1f-098d-42ef-8f0d-de739f0c4be6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:05 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:34:05 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:05 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c" returned: 0 in 0.965s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:05 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c Jul 09 01:34:05 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:06 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 1.031s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG cinder.utils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Path /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 not found in is_blk_device check {{(pid=86954) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:06 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 Jul 09 01:34:06 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:06 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-dc0f7bb2-a36f-4822-8f94-0303f559348c" returned: 0 in 0.809s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-dc0f7bb2-a36f-4822-8f94-0303f559348c" released by "delete_volume" :: held 1.841s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Created reservations ['f8fe8e8d-202a-4901-bcd7-82a6e050050a', '709539ca-7eb4-4c2d-80ce-42b44a2dcad6', 'd6eb93bc-42d4-47ae-a72c-55bc1c1e1a81', 'bf66cb59-8e02-4e6f-a439-b44cd662940e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:06 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:06 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:07 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.103s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:07 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:07 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Deleted volume successfully. Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a801cd5b-4d17-470c-9bd9-bd258ec221df tempest-ProjectReaderTests-936592836 None] Lock "cinder-dc0f7bb2-a36f-4822-8f94-0303f559348c-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (02b22b30-afbf-40ee-9502-ecaf9b77cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5121912c-78e3-4000-961d-926c0fe3339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5121912c-78e3-4000-961d-926c0fe3339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743720150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f62e740-4d76-4331-8487-2b1f3b7dc895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:08Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c872a536-68db-413d-a9c4-49bdda5bd009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c872a536-68db-413d-a9c4-49bdda5bd009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14524f3-c60e-4bcd-9b59-66acc9fa543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14524f3-c60e-4bcd-9b59-66acc9fa543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f62e740-4d76-4331-8487-2b1f3b7dc895', 'volume_name': 'volume-7f62e740-4d76-4331-8487-2b1f3b7dc895', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e502e6-7904-4d8d-86cb-8797df911142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e502e6-7904-4d8d-86cb-8797df911142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c6bd12-53f2-4157-bf6f-9ae4f9e3a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Volume 7f62e740-4d76-4331-8487-2b1f3b7dc895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f62e740-4d76-4331-8487-2b1f3b7dc895', 'volume_size': 1} Jul 09 01:34:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Flow 'volume_create_manager' (5cc5d565-9b59-4e85-9af8-d982164ccfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340d8d63-7f84-4f87-9fb4-6448a41ad733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340d8d63-7f84-4f87-9fb4-6448a41ad733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97619f9-5e2e-4617-8c07-5c9a68d728c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3c2aef2ebb46ad98add13639cba13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:11Z,use_quota=True,user_id='e0959063bad041ed80029cc1d1ca9a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85167a1f-e907-4a2b-9d89-a8c7ca6f41a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85167a1f-e907-4a2b-9d89-a8c7ca6f41a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a5be8d-8c2d-484d-8d2d-8faeda954073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:11 devstack cinder-volume[86954]: DEBUG cinder.image.glance [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Creating Keystone auth plugin from conf {{(pid=86954) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a5be8d-8c2d-484d-8d2d-8faeda954073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f97619f9-5e2e-4617-8c07-5c9a68d728c2', 'volume_name': 'volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2', 'volume_size': 1, 'image_id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bf5273dd0ba6ee6bbd1977d8a9c286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc3c2aef2ebb46ad98add13639cba13a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd918f34c913f00b6d9b6ff70287cfd233d8e820e1df0b99939f316e6345acbe77446c48aaea13f72889fb09ef4660603378ec3f97540fe63eea1e17f8351c190', 'id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'created_at': datetime.datetime(2026, 7, 8, 23, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 34, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b05057d0-fef3-4ed5-b354-778f53740f54/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b451a452-eb55-45b3-9400-8eeec1205b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b451a452-eb55-45b3-9400-8eeec1205b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9718d3-5d71-483f-a40e-abea529acce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:12 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Volume f97619f9-5e2e-4617-8c07-5c9a68d728c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2', 'volume_size': 1, 'image_id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bf5273dd0ba6ee6bbd1977d8a9c286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc3c2aef2ebb46ad98add13639cba13a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd918f34c913f00b6d9b6ff70287cfd233d8e820e1df0b99939f316e6345acbe77446c48aaea13f72889fb09ef4660603378ec3f97540fe63eea1e17f8351c190', 'id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'created_at': datetime.datetime(2026, 7, 8, 23, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 34, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b05057d0-fef3-4ed5-b354-778f53740f54/file', 'properties': {}}, 'image_service': } Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Trying to clone f97619f9-5e2e-4617-8c07-5c9a68d728c2 from image b05057d0-fef3-4ed5-b354-778f53740f54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}]). {{(pid=86954) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 01:34:12 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8" returned: 0 in 6.352s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26c23b-9e67-4e26-acad-67a539a81b8e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 01:34:12 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Image download 0.00 MB at 0.00 MB/s Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2bc9ed-4755-4401-90f5-e1012961bab7]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:12 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:34:12 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:12 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:12 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:13 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:13 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 0.974s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:13 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Image conversion details: src /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:34:13 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Converted 1024.00 MB image at 161.18 MB/s Jul 09 01:34:13 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 is being set with open permissions: ugo+rw Jul 09 01:34:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:13 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 Jul 09 01:34:13 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:13 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:13 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:14 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8" returned: 0 in 0.673s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" released by "_copy_volume_from_snapshot" :: held 10.225s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487-691ba455-b609-4836-9219-b353fbde80b8" released by "_create_volume_from_snapshot" :: held 10.276s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.319s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:14 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743720150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f62e740-4d76-4331-8487-2b1f3b7dc895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:08Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Creating volume 7f62e740-4d76-4331-8487-2b1f3b7dc895 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:14 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Temporary image b05057d0-fef3-4ed5-b354-778f53740f54 is fetched for user e0959063bad041ed80029cc1d1ca9a58. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 01:34:14 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 1073741824 Jul 09 01:34:14 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368d9e52-d797-42c4-a2ca-f115b7f1c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691ba455-b609-4836-9219-b353fbde80b8', 'volume_size': 1, 'snapshot_id': 'b3d17a37-5d22-4a43-97e6-8681debce487'}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cd9e9-2a3b-465b-8244-b6ea351db95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:14 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Volume volume-691ba455-b609-4836-9219-b353fbde80b8 (691ba455-b609-4836-9219-b353fbde80b8): created successfully Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cd9e9-2a3b-465b-8244-b6ea351db95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Flow 'volume_create_manager' (17585b79-ff65-4ca5-b763-7155993166f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:14 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-539f92cd-5fd6-4c44-bc95-34c0098d1812 tempest-SnapshotDependencyTests-614544634 None] Created volume successfully. Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2ff55-d119-48bd-8bd4-710d3a71eb6f]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:14 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:14 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-b3d17a37-5d22-4a43-97e6-8681debce487-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-b3d17a37-5d22-4a43-97e6-8681debce487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Deleting offline snapshot b3d17a37-5d22-4a43-97e6-8681debce487 of volume 225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] snapshot_file for this snap is: volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04abc3c-8671-4cc9-b1aa-fae020796555]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:15 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:34:15 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:15 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:15 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 1073741824" returned: 0 in 1.171s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:15 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 Jul 09 01:34:15 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:15 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:15 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:15 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 0.940s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225411ad-8943-4250-bb88-d5b92d655bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cfb72f-87f3-4d14-a155-94eb69ff8ea6]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:16 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:34:16 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:16 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:16 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895" returned: 0 in 0.774s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97619f9-5e2e-4617-8c07-5c9a68d728c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3c2aef2ebb46ad98add13639cba13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:11Z,use_quota=True,user_id='e0959063bad041ed80029cc1d1ca9a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Creating volume f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:16 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c6bd12-53f2-4157-bf6f-9ae4f9e3a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f62e740-4d76-4331-8487-2b1f3b7dc895', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:16 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1073741824 Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94437343-ce96-4cc5-a9ea-4b3d73b28dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:16 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:16 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Volume volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 (7f62e740-4d76-4331-8487-2b1f3b7dc895): created successfully Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94437343-ce96-4cc5-a9ea-4b3d73b28dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (02b22b30-afbf-40ee-9502-ecaf9b77cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:16 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-013ee932-ccf9-47bc-a760-557225a33851 tempest-ProjectReaderTests-936592836 None] Created volume successfully. Jul 09 01:34:16 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 0.931s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:16 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:34:16 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-7f62e740-4d76-4331-8487-2b1f3b7dc895-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "cinder-7f62e740-4d76-4331-8487-2b1f3b7dc895-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-quobyte-7f62e740-4d76-4331-8487-2b1f3b7dc895" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-7f62e740-4d76-4331-8487-2b1f3b7dc895" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:17 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1073741824" returned: 0 in 1.131s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f92988-930a-4799-be22-1f92fc29c360]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:17 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:17 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:17 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 Jul 09 01:34:17 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:17 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 0.836s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:17 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487 Jul 09 01:34:17 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (5d8631bc-ba96-4c87-9b88-67e64365c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804d67e2-d44b-4616-8405-0e114d485eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804d67e2-d44b-4616-8405-0e114d485eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711422179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:18Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec8f3f4-0e10-419b-aad6-d8b31d809cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec8f3f4-0e10-419b-aad6-d8b31d809cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71f3ce6-f391-4bc6-bf32-144d285c7774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71f3ce6-f391-4bc6-bf32-144d285c7774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d', 'volume_name': 'volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa085c9-f22a-472b-9ecc-6547249bd6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa085c9-f22a-472b-9ecc-6547249bd6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb34ba9-0cb1-43a2-91ab-3b5f094c20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:18 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Volume 69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d', 'volume_size': 1} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:18 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 0 in 0.927s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711422179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:18Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Creating volume 69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:18 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:18 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895" returned: 0 in 1.014s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:18 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d 1073741824 Jul 09 01:34:18 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Attempting download of b05057d0-fef3-4ed5-b354-778f53740f54 ((None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}])) to volume f97619f9-5e2e-4617-8c07-5c9a68d728c2. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 01:34:18 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895 Jul 09 01:34:18 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db80df-3284-4dec-ba56-b93dc1c330d4]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:18 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0.b3d17a37-5d22-4a43-97e6-8681debce487" returned: 0 in 0.867s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-b3d17a37-5d22-4a43-97e6-8681debce487" released by "_delete_snapshot" :: held 3.752s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" released by "delete_snapshot" :: held 3.797s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:18 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk Jul 09 01:34:18 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Created reservations ['9a2418d0-4b7b-45d5-bd0b-c3e26d73bd39', 'd091905e-614f-4a67-af39-420d47dbd621', 'd132b5e2-e10b-4f44-ae89-2d77aa83db54', '3f6f3042-3ea2-40c9-8404-c2cecb64810c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:18 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Delete snapshot completed successfully. Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8a87320d-6665-4045-910c-4155d978a2e2 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-b3d17a37-5d22-4a43-97e6-8681debce487-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-225411ad-8943-4250-bb88-d5b92d655bb0-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-225411ad-8943-4250-bb88-d5b92d655bb0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:19 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-7f62e740-4d76-4331-8487-2b1f3b7dc895" returned: 0 in 0.737s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-7f62e740-4d76-4331-8487-2b1f3b7dc895" released by "delete_volume" :: held 1.822s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" acquired by "delete_volume" :: waited 0.030s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc0e46-4853-4aeb-b4f2-a977a3ac6885]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Created reservations ['d94e61f0-cbcf-4bff-bd27-a36b619f3c09', '0f5058f1-beae-477a-be7f-16830c6b658a', 'cc494924-d665-40d0-9831-fd7c3e125b8b', 'c8c821cc-9e4c-4380-9731-1dc6ece86306'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:19 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:19 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:19 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:34:19 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:19 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk" returned: 0 in 0.933s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:19 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d 1073741824" returned: 0 in 1.096s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:19 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d Jul 09 01:34:19 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:19 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk Jul 09 01:34:19 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:20 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:20 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (0003e8e4-2b1c-45d1-9cd4-86b23da87af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b6655e-2601-4cc7-93c6-a1f39f2f9ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 1.155s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.052s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b6655e-2601-4cc7-93c6-a1f39f2f9ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907021952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650edde7-0235-43fa-8212-dc4f0f2af95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:20Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0 Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cace63-0e1d-4208-ac55-da857e5e2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cace63-0e1d-4208-ac55-da857e5e2045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b875d-17ef-4fd3-a4da-c3e8c758027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b875d-17ef-4fd3-a4da-c3e8c758027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650edde7-0235-43fa-8212-dc4f0f2af95b', 'volume_name': 'volume-650edde7-0235-43fa-8212-dc4f0f2af95b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943def37-79cb-48a6-8026-98070eff9b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943def37-79cb-48a6-8026-98070eff9b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb43b71-caae-488f-b6a9-26e472d306aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Volume 650edde7-0235-43fa-8212-dc4f0f2af95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650edde7-0235-43fa-8212-dc4f0f2af95b', 'volume_size': 1} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Deleted volume successfully. Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-06bd7c5a-9099-41bb-9383-d3f8ce8d5ca7 tempest-ProjectReaderTests-936592836 None] Lock "cinder-7f62e740-4d76-4331-8487-2b1f3b7dc895-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:20 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk" returned: 1 in 1.063s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b05057d0-fef3-4ed5-b354-778f53740f54_x79cfndk' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e8ee9-16f0-4a33-b059-1682be1a416e]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:20 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" returned: 0 in 1.036s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907021952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650edde7-0235-43fa-8212-dc4f0f2af95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:20Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Creating volume 650edde7-0235-43fa-8212-dc4f0f2af95b {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:20 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb34ba9-0cb1-43a2-91ab-3b5f094c20b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b 1073741824 Jul 09 01:34:20 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4aba70-da76-4a9f-a5e5-d22427727d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:20 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:20 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:20 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Volume volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d (69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d): created successfully Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4aba70-da76-4a9f-a5e5-d22427727d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:20 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (5d8631bc-ba96-4c87-9b88-67e64365c711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ab15ece1-f85a-4d10-83f5-e05bec297971 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:34:21 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-225411ad-8943-4250-bb88-d5b92d655bb0" returned: 0 in 0.761s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-225411ad-8943-4250-bb88-d5b92d655bb0" released by "delete_volume" :: held 1.994s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Created reservations ['4de73b09-5ff0-4871-a15a-24085f24a5c4', '8b835577-0bae-49e9-803c-efc2595a0915', '9db66b15-c7f5-4a20-b6c5-1a4c2a69097d', 'e23128e9-9fc7-4cd6-b1b6-d17e30857681'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:21 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:21 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:21 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:21 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD Jul 09 01:34:21 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-691ba455-b609-4836-9219-b353fbde80b8-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-691ba455-b609-4836-9219-b353fbde80b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f75ced7-d5a1-4033-8470-4df53cdab8bf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:21 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 Jul 09 01:34:21 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:21 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b 1073741824" returned: 0 in 1.201s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:21 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b Jul 09 01:34:21 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:22 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD" returned: 1 in 0.942s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] b05057d0-fef3-4ed5-b354-778f53740f54 was raw, converting to raw {{(pid=86954) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:22 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:22 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:22 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.943s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Deleted volume successfully. Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-872d609a-545b-4e25-9f09-7d99079bce86 tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-225411ad-8943-4250-bb88-d5b92d655bb0-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:22 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8" returned: 0 in 1.091s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:22 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8 Jul 09 01:34:22 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:22 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b" returned: 0 in 0.892s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 825a4d71-f7f3-46a7-bfd2-a17b9d928c4c of volume 69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb43b71-caae-488f-b6a9-26e472d306aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650edde7-0235-43fa-8212-dc4f0f2af95b', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d0ebe4-cb5e-44ef-8cd2-5ee229672579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497e5e0-a258-4bd4-8222-0fbe67de144a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:22 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Volume volume-650edde7-0235-43fa-8212-dc4f0f2af95b (650edde7-0235-43fa-8212-dc4f0f2af95b): created successfully Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d0ebe4-cb5e-44ef-8cd2-5ee229672579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:22 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (0003e8e4-2b1c-45d1-9cd4-86b23da87af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:22 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-7fc5e1e3-571e-4496-9d34-f76fdee5e9ac tempest-ProjectReaderTests-936592836 None] Created volume successfully. Jul 09 01:34:22 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d Jul 09 01:34:22 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:23 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 0 in 0.878s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b05057d0-fef3-4ed5-b354-778f53740f54_0nhomwpndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 01:34:23 devstack cinder-volume[86954]: INFO cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:23 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1G Jul 09 01:34:23 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-650edde7-0235-43fa-8212-dc4f0f2af95b-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:23 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-691ba455-b609-4836-9219-b353fbde80b8" returned: 0 in 0.770s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "cinder-650edde7-0235-43fa-8212-dc4f0f2af95b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-quobyte-691ba455-b609-4836-9219-b353fbde80b8" released by "delete_volume" :: held 1.939s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-quobyte-650edde7-0235-43fa-8212-dc4f0f2af95b" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-650edde7-0235-43fa-8212-dc4f0f2af95b" acquired by "delete_volume" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d05987-93af-4464-a6b7-dab7df6179c0]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Created reservations ['54976318-5c8a-4e07-8436-eb207f7d4227', '75bd2013-380b-47f0-8106-3e196116249a', 'a0f000c0-0df4-45fa-bd98-f5fc3d748109', '33a5e9b7-bb1e-4c37-a6a8-9542434b0f7f'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:23 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" returned: 0 in 0.937s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:23 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b Jul 09 01:34:23 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:23 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:23 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:23 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c 1G Jul 09 01:34:23 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:24 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 1G" returned: 0 in 1.050s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec6f79-f358-4f96-bda1-539d7b622784]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:24 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:24 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:24 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b" returned: 0 in 1.123s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:24 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.040s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:24 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b Jul 09 01:34:24 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Deleted volume successfully. Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5d121a94-ce6b-49bc-b023-8c864551e40e tempest-SnapshotDependencyTests-614544634 None] Lock "cinder-691ba455-b609-4836-9219-b353fbde80b8-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:24 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c 1G" returned: 0 in 1.186s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:24 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c Jul 09 01:34:24 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:25 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 0 in 1.053s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:25 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:25 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:25 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-650edde7-0235-43fa-8212-dc4f0f2af95b" returned: 0 in 0.873s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-650edde7-0235-43fa-8212-dc4f0f2af95b" released by "delete_volume" :: held 2.051s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Created reservations ['05a77c39-ad3f-4f49-9a31-3c3a1bfd46b8', '4f7936d9-8b8a-4e74-9baf-964035df5159', 'aa025ca8-af30-4044-9925-0bf737dcf4e7', 'c596d19f-6ff4-4d4b-a613-805816436082'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:25 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" returned: 0 in 0.870s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:25 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c is being set with open permissions: ugo+rw Jul 09 01:34:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:25 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:25 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:25 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c Jul 09 01:34:25 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:26 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 1 in 0.941s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Downloaded image b05057d0-fef3-4ed5-b354-778f53740f54 ((None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}])) to volume f97619f9-5e2e-4617-8c07-5c9a68d728c2 successfully. {{(pid=86954) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.image.image_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Temporary image b05057d0-fef3-4ed5-b354-778f53740f54 for user e0959063bad041ed80029cc1d1ca9a58 is deleted. {{(pid=86954) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.volume_utils [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Marking volume f97619f9-5e2e-4617-8c07-5c9a68d728c2 as bootable. {{(pid=86954) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Copying metadata from image b05057d0-fef3-4ed5-b354-778f53740f54 to f97619f9-5e2e-4617-8c07-5c9a68d728c2. {{(pid=86954) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Creating volume glance metadata for volume f97619f9-5e2e-4617-8c07-5c9a68d728c2 backed by image b05057d0-fef3-4ed5-b354-778f53740f54 with: {'image_id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f5bf5273dd0ba6ee6bbd1977d8a9c286', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86954) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9718d3-5d71-483f-a40e-abea529acce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2', 'volume_size': 1, 'image_id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b05057d0-fef3-4ed5-b354-778f53740f54', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bf5273dd0ba6ee6bbd1977d8a9c286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc3c2aef2ebb46ad98add13639cba13a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd918f34c913f00b6d9b6ff70287cfd233d8e820e1df0b99939f316e6345acbe77446c48aaea13f72889fb09ef4660603378ec3f97540fe63eea1e17f8351c190', 'id': 'b05057d0-fef3-4ed5-b354-778f53740f54', 'created_at': datetime.datetime(2026, 7, 8, 23, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 23, 34, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b05057d0-fef3-4ed5-b354-778f53740f54/file', 'properties': {}}, 'image_service': }' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022a4a41-46ad-4dfb-9146-d28c9acd5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:26 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Volume volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 (f97619f9-5e2e-4617-8c07-5c9a68d728c2): created successfully Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022a4a41-46ad-4dfb-9146-d28c9acd5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Flow 'volume_create_manager' (5cc5d565-9b59-4e85-9af8-d982164ccfb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ee6d713d-2e2e-4339-b545-1cca05aa06c4 tempest-VolumeImageDependencyTests-150040851 None] Created volume successfully. Jul 09 01:34:26 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.826s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:26 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Deleted volume successfully. Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-1d34de40-a92e-4e51-9f26-60ba74d2b37c tempest-ProjectReaderTests-936592836 None] Lock "cinder-650edde7-0235-43fa-8212-dc4f0f2af95b-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:26 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" returned: 0 in 0.924s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:26 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info Jul 09 01:34:26 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (b4435147-f90f-4e74-8971-9e39266b951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06371e99-63e5-40bf-8dd3-0540649677ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06371e99-63e5-40bf-8dd3-0540649677ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802241120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4677751e-fe5a-4317-b3ae-29678b79ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:27Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:27 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17460b7-6344-4f51-bdff-b4d5bdfcb298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17460b7-6344-4f51-bdff-b4d5bdfcb298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0802b165-5eed-43bd-9209-4625a97280ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0802b165-5eed-43bd-9209-4625a97280ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4677751e-fe5a-4317-b3ae-29678b79ca10', 'volume_name': 'volume-4677751e-fe5a-4317-b3ae-29678b79ca10', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c0479-7fa7-4aeb-a9f6-f6f73d11dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c0479-7fa7-4aeb-a9f6-f6f73d11dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc37232-3f79-47ec-adaa-59aaf553a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:27 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Volume 4677751e-fe5a-4317-b3ae-29678b79ca10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4677751e-fe5a-4317-b3ae-29678b79ca10', 'volume_size': 1} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info" returned: 0 in 0.816s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:27 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info is being set with open permissions: ugo+rw Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:27 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info Jul 09 01:34:27 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Acquiring lock "cinder-f97619f9-5e2e-4617-8c07-5c9a68d728c2-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "cinder-f97619f9-5e2e-4617-8c07-5c9a68d728c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Acquiring lock "cinder-quobyte-f97619f9-5e2e-4617-8c07-5c9a68d728c2" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "cinder-quobyte-f97619f9-5e2e-4617-8c07-5c9a68d728c2" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dc5860-29aa-43f0-8ec8-5fe04801ba8c]: (4, 'raw') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:27 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:27 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:28 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.info" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.680s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802241120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4677751e-fe5a-4317-b3ae-29678b79ca10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e5d88351284440ac81c8847cb1766f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:27Z,use_quota=True,user_id='2b50a0f4002d476d94307053b2da3164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Creating volume 4677751e-fe5a-4317-b3ae-29678b79ca10 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:28 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:28 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 1073741824 Jul 09 01:34:28 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-1149818a-98da-4ee2-ae7d-c822372a31a3 tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:34:28 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 0 in 0.975s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:28 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:28 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:29 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 1073741824" returned: 0 in 1.102s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:29 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 Jul 09 01:34:29 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 825a4d71-f7f3-46a7-bfd2-a17b9d928c4c of volume 69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56135d73-2771-41b2-af83-0f3b47181047]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:29 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 1 in 0.987s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2' failed. Not Retrying. {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 01:34:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:29 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2 Jul 09 01:34:29 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:29 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c Jul 09 01:34:29 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:30 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10" returned: 0 in 0.841s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc37232-3f79-47ec-adaa-59aaf553a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4677751e-fe5a-4317-b3ae-29678b79ca10', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a26648-55d1-4ebc-9386-6ad42272ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Volume volume-4677751e-fe5a-4317-b3ae-29678b79ca10 (4677751e-fe5a-4317-b3ae-29678b79ca10): created successfully Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a26648-55d1-4ebc-9386-6ad42272ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Flow 'volume_create_manager' (b4435147-f90f-4e74-8971-9e39266b951c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a8b619c2-da55-47d4-b227-e0d6af986157 tempest-ProjectReaderTests-936592836 None] Created volume successfully. Jul 09 01:34:30 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f97619f9-5e2e-4617-8c07-5c9a68d728c2" returned: 0 in 0.805s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "cinder-quobyte-f97619f9-5e2e-4617-8c07-5c9a68d728c2" released by "delete_volume" :: held 2.846s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:30 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" returned: 0 in 0.967s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Created reservations ['b3de4c02-2b52-41a4-9b3a-5b233380a3b9', 'cb2b7bde-31bc-45f3-ae42-5c43f29fdd49', 'def5ba0f-9ee4-403c-9a6b-879e40c3efa6', '4e4193a4-b656-4cbb-b13b-a1f0fd45a0bb'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a5e85-f366-40b2-9bd6-fbe2feae8c43]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:30 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:30 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:30 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d Jul 09 01:34:30 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:31 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.823s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:31 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Deleted volume successfully. Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-4677751e-fe5a-4317-b3ae-29678b79ca10-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bd28ecc1-0291-4a4d-9dff-661e1a462736 tempest-VolumeImageDependencyTests-150040851 None] Lock "cinder-f97619f9-5e2e-4617-8c07-5c9a68d728c2-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "cinder-4677751e-fe5a-4317-b3ae-29678b79ca10-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Acquiring lock "cinder-quobyte-4677751e-fe5a-4317-b3ae-29678b79ca10" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-4677751e-fe5a-4317-b3ae-29678b79ca10" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4adf6d-8976-41a8-a22c-07a2a210f97b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:31 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" returned: 0 in 1.106s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:31 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c Jul 09 01:34:31 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:31 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 Jul 09 01:34:31 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:32 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10" returned: 0 in 1.184s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:32 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" returned: 0 in 1.174s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:33 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10 Jul 09 01:34:33 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:33 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c Jul 09 01:34:33 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:33 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d.825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" returned: 0 in 0.872s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:33 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:33 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:33 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4677751e-fe5a-4317-b3ae-29678b79ca10" returned: 0 in 0.959s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c" released by "_delete_snapshot" :: held 4.298s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "cinder-quobyte-4677751e-fe5a-4317-b3ae-29678b79ca10" released by "delete_volume" :: held 2.197s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" released by "delete_snapshot" :: held 4.342s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Created reservations ['2a68ab93-2f37-4b13-b627-68ad518bbe55', '2714f132-8d23-46d6-915a-7b698c1bdc3d', '40bec96c-21ed-4be6-98f1-81887ed420e8', '9184941e-96e2-4003-9635-bf31915a9be7'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Created reservations ['92637052-fdf4-4af8-9ef9-90049218c589', '1e5901d5-9c2e-470e-9e27-56415c677c53', '8a68893b-f814-4546-8552-07d0236786a5', '2f9652c4-978a-4e44-92d3-601eada75674'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:34 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:34 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:34 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-6ec6351a-07e0-403c-936a-6f0d7b31b5c7 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-825a4d71-f7f3-46a7-bfd2-a17b9d928c4c-delete_snapshot" released by "delete_snapshot" :: held 4.726s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:34 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.964s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:34:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" acquired by "delete_volume" :: waited 0.033s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d4c53-a657-4f63-a130-cd7b4f009ffd]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:35 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 1.167s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Deleted volume successfully. Jul 09 01:34:35 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d Jul 09 01:34:35 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5c7ff452-3d9b-46db-b594-e738080d43ec tempest-ProjectReaderTests-936592836 None] Lock "cinder-4677751e-fe5a-4317-b3ae-29678b79ca10-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:36 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" returned: 0 in 1.016s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:36 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d Jul 09 01:34:36 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:37 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d" released by "delete_volume" :: held 1.895s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=209,cinder:SELECT=161,cinder:DELETE=20,cinder:INSERT=47 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=160,cinder:INSERT=72,cinder:UPDATE=238,cinder:DELETE=16 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-941f8c5e-8e99-4cad-9ed4-9653045a9cc2 tempest-ProjectAdminTests-636690019 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545356750488, 'free_capacity_gb': 1775.7545356750488, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86954) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Created reservations ['3e4b5fad-c09f-4cf3-a8d9-ea7b09f0476c', '33aa022b-2c16-43c8-9480-e4da07033f3d', 'c19bb748-883b-4b74-aae6-8bdddd2ef941', '955ad1eb-6797-489c-9ce3-0688ef5050ca'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:37 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:37 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:37 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.773s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:37 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (7dd7cf66-b7bd-454c-be3b-8bfc1d176d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3dbaf54-8484-46f6-b5d8-2554c83b4858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-f5f7968a-4ae2-4aa7-bba2-04dd59edc152 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-69d7a45c-5ed6-44b0-ba6c-9c9d80d8752d-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3dbaf54-8484-46f6-b5d8-2554c83b4858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614590156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951d7b94-1586-437e-809b-3f9060a51877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:38Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747bd288-41b7-457f-936d-556097603ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747bd288-41b7-457f-936d-556097603ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26205e0-bbe1-44ed-8a4c-79e66d55c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26205e0-bbe1-44ed-8a4c-79e66d55c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951d7b94-1586-437e-809b-3f9060a51877', 'volume_name': 'volume-951d7b94-1586-437e-809b-3f9060a51877', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38097b-4cc2-4101-be26-0d9df1757710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38097b-4cc2-4101-be26-0d9df1757710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40cc182-2e3d-4388-b145-f70198258229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:38 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Volume 951d7b94-1586-437e-809b-3f9060a51877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951d7b94-1586-437e-809b-3f9060a51877', 'volume_size': 1} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614590156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951d7b94-1586-437e-809b-3f9060a51877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:38Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Creating volume 951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:38 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:38 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 1073741824 Jul 09 01:34:38 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:39 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 1073741824" returned: 0 in 0.948s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:39 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 Jul 09 01:34:39 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:39 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877" returned: 0 in 0.730s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40cc182-2e3d-4388-b145-f70198258229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951d7b94-1586-437e-809b-3f9060a51877', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc882058-d093-4f4d-9ed2-80bf893afca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:39 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Volume volume-951d7b94-1586-437e-809b-3f9060a51877 (951d7b94-1586-437e-809b-3f9060a51877): created successfully Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc882058-d093-4f4d-9ed2-80bf893afca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:39 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (7dd7cf66-b7bd-454c-be3b-8bfc1d176d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0d50bc3e-a431-4acd-b847-3cf6d0b922af tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:34:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:40 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 8153fe2c-5599-471b-9980-1a167944d518 of volume 951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:34:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2dbac8-76cb-4683-87fd-820f2443c099]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:40 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 Jul 09 01:34:40 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:41 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877" returned: 0 in 0.782s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:41 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 1G Jul 09 01:34:41 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (e4f5ee49-763d-4cdd-92b6-3510287335a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f257cbf7-6d8e-45b6-a283-4ff918c3c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f257cbf7-6d8e-45b6-a283-4ff918c3c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123344528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603b0cd0-6b7a-4893-bbe7-8e32ac32a408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:42Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab0955e-b796-42e2-94e9-265bfcad9689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab0955e-b796-42e2-94e9-265bfcad9689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f4c0c5-3de0-4c9f-a607-52ad7a99a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f4c0c5-3de0-4c9f-a607-52ad7a99a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603b0cd0-6b7a-4893-bbe7-8e32ac32a408', 'volume_name': 'volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f558eb8e-c0be-4009-8758-e098f0b69675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f558eb8e-c0be-4009-8758-e098f0b69675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b950973-ce5e-4fd2-a50a-f4a52f36e2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:41 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Volume 603b0cd0-6b7a-4893-bbe7-8e32ac32a408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408', 'volume_size': 1} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:41 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 1G" returned: 0 in 0.834s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951d7b94-1586-437e-809b-3f9060a51877 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:41 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951d7b94-1586-437e-809b-3f9060a51877 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 Jul 09 01:34:41 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:42 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951d7b94-1586-437e-809b-3f9060a51877 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518" returned: 0 in 0.711s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:42 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 is being set with open permissions: ugo+rw Jul 09 01:34:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:42 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 Jul 09 01:34:42 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:43 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518" returned: 0 in 0.638s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:43 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info Jul 09 01:34:43 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:43 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:43 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info is being set with open permissions: ugo+rw Jul 09 01:34:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:43 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info Jul 09 01:34:43 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:44 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.info" returned: 0 in 0.628s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.965s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123344528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603b0cd0-6b7a-4893-bbe7-8e32ac32a408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:42Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Creating volume 603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:44 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:44 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 1073741824 Jul 09 01:34:44 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ee997db2-6a80-4d68-af4d-41929c9a1f16 tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:34:45 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 1073741824" returned: 0 in 0.788s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:45 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 Jul 09 01:34:45 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-8153fe2c-5599-471b-9980-1a167944d518-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-8153fe2c-5599-471b-9980-1a167944d518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-8153fe2c-5599-471b-9980-1a167944d518" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-8153fe2c-5599-471b-9980-1a167944d518" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 8153fe2c-5599-471b-9980-1a167944d518 of volume 951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aff6c1-a109-4045-9c9c-dd463795899b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:45 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 Jul 09 01:34:45 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:46 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b950973-ce5e-4fd2-a50a-f4a52f36e2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670443b7-6856-4d0f-8720-b5c6154cbcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:46 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Volume volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 (603b0cd0-6b7a-4893-bbe7-8e32ac32a408): created successfully Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670443b7-6856-4d0f-8720-b5c6154cbcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (e4f5ee49-763d-4cdd-92b6-3510287335a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-3a50cd9e-96ca-448e-b2e8-8c237eafa3df tempest-ProjectReaderTests-796009963 None] Created volume successfully. Jul 09 01:34:46 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518" returned: 0 in 0.863s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-951d7b94-1586-437e-809b-3f9060a51877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7da8b-414f-4e10-ac3b-02b1232c77ef]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:46 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 Jul 09 01:34:46 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Creating offline snapshot d28f75f7-772b-4f3e-a259-d748960ddaf6 of volume 603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27870f74-f6eb-479e-83a2-9b7a1851f80f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:47 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 Jul 09 01:34:47 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:47 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877" returned: 0 in 0.840s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:47 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 Jul 09 01:34:47 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:47 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" returned: 0 in 0.849s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:47 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 1G Jul 09 01:34:47 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:48 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:48 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518 Jul 09 01:34:48 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:48 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 1G" returned: 0 in 0.848s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:48 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877.8153fe2c-5599-471b-9980-1a167944d518" returned: 0 in 0.698s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:48 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 Jul 09 01:34:48 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-8153fe2c-5599-471b-9980-1a167944d518" released by "_delete_snapshot" :: held 3.310s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" released by "delete_snapshot" :: held 3.332s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Created reservations ['e7a4d138-54b5-48b2-b5be-fb12de1f14f8', '2f7c0f5b-1b9f-4712-bb02-5fc07421ab15', '3646b5e9-127d-4161-a473-2120735b69c3', '65505ba1-aa5f-4499-b716-3b092b08bfca'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:34:48 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d3731829-add5-45ec-a714-af851861480c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-8153fe2c-5599-471b-9980-1a167944d518-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:49 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6" returned: 0 in 0.724s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:49 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 is being set with open permissions: ugo+rw Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:49 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 Jul 09 01:34:49 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-951d7b94-1586-437e-809b-3f9060a51877-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "cinder-951d7b94-1586-437e-809b-3f9060a51877-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce9651-78ef-4ae5-b19c-45a8bdedf8e1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:50 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 Jul 09 01:34:50 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:50 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:50 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info Jul 09 01:34:50 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:50 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:50 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877 Jul 09 01:34:50 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:50 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:50 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info is being set with open permissions: ugo+rw Jul 09 01:34:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:50 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info Jul 09 01:34:50 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:51 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-951d7b94-1586-437e-809b-3f9060a51877" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-951d7b94-1586-437e-809b-3f9060a51877" released by "delete_volume" :: held 1.548s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Created reservations ['e798e49d-5022-4719-9bfa-f6022b2ea9c8', 'be47f237-ebfb-4160-b331-55d771da40ce', '03701547-a6a8-4381-b0bc-b4ec56f3fa43', '732c8351-039c-401c-abcb-5415d10a7972'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:51 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:51 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:51 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.info" returned: 0 in 0.673s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.563s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b40ae590-d09a-4bbd-a9e4-3c09e576875f tempest-ProjectReaderTests-796009963 None] Create snapshot completed successfully Jul 09 01:34:52 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-d18ceaa3-15cd-4b9c-b357-27ec135f178b tempest-ProjectMemberTests-1209260408 None] Lock "cinder-951d7b94-1586-437e-809b-3f9060a51877-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-d28f75f7-772b-4f3e-a259-d748960ddaf6-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-d28f75f7-772b-4f3e-a259-d748960ddaf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-d28f75f7-772b-4f3e-a259-d748960ddaf6" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (7cd7335b-4fca-4ffa-bb22-dc8bc7264273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26be1f6-f64e-4c7c-9638-5b0a6afad802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-d28f75f7-772b-4f3e-a259-d748960ddaf6" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Deleting offline snapshot d28f75f7-772b-4f3e-a259-d748960ddaf6 of volume 603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] snapshot_file for this snap is: volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26be1f6-f64e-4c7c-9638-5b0a6afad802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483007936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662e085e-4dab-4023-8617-fd140d8449fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:52Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6352b6e-f08b-4c23-8f32-b3653c670b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6352b6e-f08b-4c23-8f32-b3653c670b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13ad09f-d36c-4a9d-a7bc-a8542a3d414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13ad09f-d36c-4a9d-a7bc-a8542a3d414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662e085e-4dab-4023-8617-fd140d8449fa', 'volume_name': 'volume-662e085e-4dab-4023-8617-fd140d8449fa', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e6be7-4270-4674-887d-49cae824b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e6be7-4270-4674-887d-49cae824b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b524a90-5d6a-40be-ab59-0a16cc525793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Volume 662e085e-4dab-4023-8617-fd140d8449fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662e085e-4dab-4023-8617-fd140d8449fa', 'volume_size': 1} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483007936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662e085e-4dab-4023-8617-fd140d8449fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:52Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Creating volume 662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:52 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7364b4-13c1-416b-88c9-153f7c7bcd5a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:52 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa 1073741824 Jul 09 01:34:52 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:52 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 Jul 09 01:34:52 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:53 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6" returned: 0 in 0.828s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:34:53 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa 1073741824" returned: 0 in 0.861s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e04e0-436c-4760-814a-e70016743705]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:53 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa Jul 09 01:34:53 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:53 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 Jul 09 01:34:53 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:54 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b524a90-5d6a-40be-ab59-0a16cc525793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662e085e-4dab-4023-8617-fd140d8449fa', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2238af13-29d3-49a0-b80f-a98cf8cb6140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:54 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Volume volume-662e085e-4dab-4023-8617-fd140d8449fa (662e085e-4dab-4023-8617-fd140d8449fa): created successfully Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2238af13-29d3-49a0-b80f-a98cf8cb6140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (7cd7335b-4fca-4ffa-bb22-dc8bc7264273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:54 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-41bed359-ffca-42d8-b14a-53f58a929c86 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:34:54 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" returned: 0 in 0.782s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:54 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 Jul 09 01:34:54 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 9da7c97a-0f3a-475d-99cd-e0b815237b0d of volume 662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4640f3c-f358-4924-b4bc-0e29e72f82be]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:54 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa Jul 09 01:34:54 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:55 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6" returned: 0 in 0.768s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:55 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6 Jul 09 01:34:55 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:55 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa" returned: 0 in 0.777s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:55 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d 1G Jul 09 01:34:55 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:55 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408.d28f75f7-772b-4f3e-a259-d748960ddaf6" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-d28f75f7-772b-4f3e-a259-d748960ddaf6" released by "_delete_snapshot" :: held 3.209s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" released by "delete_snapshot" :: held 3.265s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Created reservations ['e91c075e-f3d7-4443-b20f-45a474793d27', '37d576cc-17d7-41e2-82a0-bcf625fb0565', '89240fa6-aa3a-49da-a5fd-d1d0a2683cda', '89487f6a-26db-44e0-9f9b-456fe7d6630b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:55 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Delete snapshot completed successfully. Jul 09 01:34:55 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c496d05e-d315-49eb-a5cf-2aa87d1a81ec tempest-ProjectReaderTests-796009963 None] Lock "cinder-d28f75f7-772b-4f3e-a259-d748960ddaf6-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:56 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d 1G" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662e085e-4dab-4023-8617-fd140d8449fa -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:56 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662e085e-4dab-4023-8617-fd140d8449fa -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d Jul 09 01:34:56 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-603b0cd0-6b7a-4893-bbe7-8e32ac32a408-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "cinder-603b0cd0-6b7a-4893-bbe7-8e32ac32a408-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79db10-a81c-4ae0-85a2-7d5eff4f4ddf]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:34:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:56 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 Jul 09 01:34:56 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:57 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662e085e-4dab-4023-8617-fd140d8449fa -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:57 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d is being set with open permissions: ugo+rw Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:57 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d Jul 09 01:34:57 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:57 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:57 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408 Jul 09 01:34:57 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:57 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:57 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info Jul 09 01:34:57 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:58 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" returned: 0 in 0.694s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-603b0cd0-6b7a-4893-bbe7-8e32ac32a408" released by "delete_volume" :: held 1.591s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Created reservations ['183fbeab-189c-4f60-b8b0-4968195907e3', '9a401409-073b-4503-9ec2-e7a665b1463e', '9b5726c5-e548-4ee7-961a-7bf5e275a82c', '411cdbaa-9526-4c81-b398-82876a085414'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:58 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info" returned: 0 in 0.668s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:58 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info is being set with open permissions: ugo+rw Jul 09 01:34:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:58 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:34:58 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:58 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info Jul 09 01:34:58 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:34:59 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.665s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:34:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Deleted volume successfully. Jul 09 01:34:59 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.info" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4d0a3a2b-7dea-4653-a826-cdb69535569f tempest-ProjectReaderTests-796009963 None] Lock "cinder-603b0cd0-6b7a-4893-bbe7-8e32ac32a408-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:34:59 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0ff966c5-86f9-4cdb-b784-a3b29c8d50be tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (0276006e-1b51-4178-871a-2b723b54b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04db1074-41c2-4bff-b049-04796a98a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04db1074-41c2-4bff-b049-04796a98a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134347119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fbb61-2e8c-4309-9d03-2ba7598f4049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:59Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0825d495-d998-4423-aa37-63e83fdbd5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0825d495-d998-4423-aa37-63e83fdbd5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46962c0f-7f57-4771-88e3-c51c10d77856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46962c0f-7f57-4771-88e3-c51c10d77856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905fbb61-2e8c-4309-9d03-2ba7598f4049', 'volume_name': 'volume-905fbb61-2e8c-4309-9d03-2ba7598f4049', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11189a50-ad76-45d1-87ad-67552a52c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11189a50-ad76-45d1-87ad-67552a52c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581d6079-8945-473a-944b-fe412be92877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:34:59 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Volume 905fbb61-2e8c-4309-9d03-2ba7598f4049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905fbb61-2e8c-4309-9d03-2ba7598f4049', 'volume_size': 1} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134347119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fbb61-2e8c-4309-9d03-2ba7598f4049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:34:59Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Creating volume 905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:34:59 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:34:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:34:59 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 1073741824 Jul 09 01:34:59 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-9da7c97a-0f3a-475d-99cd-e0b815237b0d-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-9da7c97a-0f3a-475d-99cd-e0b815237b0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-9da7c97a-0f3a-475d-99cd-e0b815237b0d" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-9da7c97a-0f3a-475d-99cd-e0b815237b0d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 9da7c97a-0f3a-475d-99cd-e0b815237b0d of volume 662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6fb3a-88a3-4764-a95a-d28a0cc02349]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:00 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d Jul 09 01:35:00 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:00 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 1073741824" returned: 0 in 0.857s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:00 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 Jul 09 01:35:00 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:00 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662e085e-4dab-4023-8617-fd140d8449fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6eb763-dd19-424d-ad52-fd4b5dbe1f57]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:01 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049" returned: 0 in 0.654s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:01 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa Jul 09 01:35:01 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581d6079-8945-473a-944b-fe412be92877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905fbb61-2e8c-4309-9d03-2ba7598f4049', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1d5d6d-2fc4-4761-826f-7acef8b41f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:01 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Volume volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 (905fbb61-2e8c-4309-9d03-2ba7598f4049): created successfully Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1d5d6d-2fc4-4761-826f-7acef8b41f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (0276006e-1b51-4178-871a-2b723b54b649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:01 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-88532a37-5adf-41ed-b353-952e6b26aac5 tempest-ProjectReaderTests-796009963 None] Created volume successfully. Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Creating offline snapshot 27d93c24-c287-40ed-b826-c4dcc4fde25a of volume 905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5467250-292a-494c-a19c-b62a71209e2f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:01 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa" returned: 0 in 0.864s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:01 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:01 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 Jul 09 01:35:01 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:01 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d Jul 09 01:35:01 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:02 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:02 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d" returned: 0 in 0.746s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:02 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a 1G Jul 09 01:35:02 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:02 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d Jul 09 01:35:02 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:03 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa.9da7c97a-0f3a-475d-99cd-e0b815237b0d" returned: 0 in 0.678s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-9da7c97a-0f3a-475d-99cd-e0b815237b0d" released by "_delete_snapshot" :: held 3.193s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" released by "delete_snapshot" :: held 3.220s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:03 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Created reservations ['7ef82ff2-1814-441b-8105-c64207feb929', 'ef7db01e-e0d5-4f56-9a83-bd236ff91afc', '784e7e1a-ccb1-4ada-af24-9f8e48e95b81', '4d6cc316-7439-41d1-ae4c-bee35c44127c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a 1G" returned: 0 in 0.803s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:03 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a Jul 09 01:35:03 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:03 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:35:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-cb19cfed-91d5-4f51-8239-c12a92e6acb0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-9da7c97a-0f3a-475d-99cd-e0b815237b0d-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:04 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:04 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a is being set with open permissions: ugo+rw Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:04 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a Jul 09 01:35:04 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-662e085e-4dab-4023-8617-fd140d8449fa-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-662e085e-4dab-4023-8617-fd140d8449fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf94227-62bb-4cc0-8d3b-6ce0665608b3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:04 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa Jul 09 01:35:04 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:04 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:04 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info Jul 09 01:35:04 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:05 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa" returned: 0 in 0.779s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:05 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa Jul 09 01:35:05 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:05 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info" returned: 0 in 0.649s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:05 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info is being set with open permissions: ugo+rw Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:05 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info Jul 09 01:35:05 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:05 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-662e085e-4dab-4023-8617-fd140d8449fa" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-662e085e-4dab-4023-8617-fd140d8449fa" released by "delete_volume" :: held 1.504s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Created reservations ['118c7fdb-6f6c-4d19-8522-fc30dfac11df', '003e14e4-b388-4c58-abb8-0dff052917fc', 'ad456ae5-897c-4666-a610-564cb315b14e', '05de2ff7-2eed-4add-ae64-e73f4c21660a'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:06 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:06 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:06 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.info" returned: 0 in 0.647s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-98e00289-d562-4b46-a48d-6fac87b520c9 tempest-ProjectReaderTests-796009963 None] Create snapshot completed successfully Jul 09 01:35:06 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-c54354de-c491-4fbf-a63d-d66fa84f2132 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-662e085e-4dab-4023-8617-fd140d8449fa-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-27d93c24-c287-40ed-b826-c4dcc4fde25a-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-27d93c24-c287-40ed-b826-c4dcc4fde25a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-27d93c24-c287-40ed-b826-c4dcc4fde25a" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (457fdd4d-eed3-4430-8728-379f01c9a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7526e073-b3ea-47b0-967f-b700f31403dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7526e073-b3ea-47b0-967f-b700f31403dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62349855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66723ee-96e3-47c3-9cca-418386167828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:07Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5134c87f-f587-4e29-9a2d-93f13535ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5134c87f-f587-4e29-9a2d-93f13535ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd15873-80ce-4007-85b1-9d54b21fe349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd15873-80ce-4007-85b1-9d54b21fe349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66723ee-96e3-47c3-9cca-418386167828', 'volume_name': 'volume-d66723ee-96e3-47c3-9cca-418386167828', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9023e564-cc54-428f-b07e-41091c959d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9023e564-cc54-428f-b07e-41091c959d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514196d-4cc9-43c9-8d40-59f557af8e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:07 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Volume d66723ee-96e3-47c3-9cca-418386167828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66723ee-96e3-47c3-9cca-418386167828', 'volume_size': 1} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62349855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66723ee-96e3-47c3-9cca-418386167828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:07Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Creating volume d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:07 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-27d93c24-c287-40ed-b826-c4dcc4fde25a" acquired by "_delete_snapshot" :: waited 0.111s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Deleting offline snapshot 27d93c24-c287-40ed-b826-c4dcc4fde25a of volume 905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:07 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 1073741824 Jul 09 01:35:07 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] snapshot_file for this snap is: volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2658f4-2f92-470c-ad15-461c718418ab]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:07 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a Jul 09 01:35:07 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:07 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a" returned: 0 in 0.768s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905fbb61-2e8c-4309-9d03-2ba7598f4049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:07 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb436f03-30fc-43a7-9bde-4b3b181eae57]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 1073741824" returned: 0 in 0.891s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:08 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 Jul 09 01:35:08 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:08 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 Jul 09 01:35:08 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:08 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:08 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514196d-4cc9-43c9-8d40-59f557af8e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66723ee-96e3-47c3-9cca-418386167828', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cf8e3-4ed0-421b-910b-b0b9355cca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:08 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Volume volume-d66723ee-96e3-47c3-9cca-418386167828 (d66723ee-96e3-47c3-9cca-418386167828): created successfully Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cf8e3-4ed0-421b-910b-b0b9355cca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:08 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a Jul 09 01:35:08 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:08 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (457fdd4d-eed3-4430-8728-379f01c9a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:08 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-fb24f01b-53fc-4f5b-89ed-f604d5f0afb4 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 23640d9c-80e7-4c2c-80a6-7dc801c0a5dd of volume d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843713b-e087-427f-8952-ef751990ca22]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:09 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 Jul 09 01:35:09 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:09 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a" returned: 0 in 0.744s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:09 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a Jul 09 01:35:09 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:09 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828" returned: 0 in 0.798s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:10 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd 1G Jul 09 01:35:10 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:10 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049.27d93c24-c287-40ed-b826-c4dcc4fde25a" returned: 0 in 0.624s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-27d93c24-c287-40ed-b826-c4dcc4fde25a" released by "_delete_snapshot" :: held 3.036s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" released by "delete_snapshot" :: held 3.162s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Created reservations ['66d51ae1-cd0c-44af-b805-3833599b5474', 'f2062d1c-0650-40b7-a775-18e09c1969f8', 'bba23089-fdbe-41d4-8ff0-5d504ce6a410', '6438b254-51ff-4dce-89cf-235a95c9e423'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Delete snapshot completed successfully. Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-14885a20-c09e-4794-a8d3-13425e0b6150 tempest-ProjectReaderTests-796009963 None] Lock "cinder-27d93c24-c287-40ed-b826-c4dcc4fde25a-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:10 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd 1G" returned: 0 in 0.838s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66723ee-96e3-47c3-9cca-418386167828 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:10 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66723ee-96e3-47c3-9cca-418386167828 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd Jul 09 01:35:10 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-905fbb61-2e8c-4309-9d03-2ba7598f4049-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "cinder-905fbb61-2e8c-4309-9d03-2ba7598f4049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" acquired by "delete_volume" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc02971-38da-4e98-83f5-638f617e8acb]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:11 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 Jul 09 01:35:11 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:11 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66723ee-96e3-47c3-9cca-418386167828 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" returned: 0 in 0.752s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:11 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd is being set with open permissions: ugo+rw Jul 09 01:35:11 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:11 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd Jul 09 01:35:11 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:12 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049" returned: 0 in 0.788s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:12 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049 Jul 09 01:35:12 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:12 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" returned: 0 in 0.640s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:12 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info Jul 09 01:35:12 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:12 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-905fbb61-2e8c-4309-9d03-2ba7598f4049" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-905fbb61-2e8c-4309-9d03-2ba7598f4049" released by "delete_volume" :: held 1.552s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Created reservations ['25af96e2-b0da-438c-8da6-02868fb4248b', 'f7f2cd62-ac96-47b1-89b9-3bab45ef3439', 'd4f54bbf-c7de-4ed1-9f2d-947b3927914c', '7ac204d7-3861-4b69-86c6-9b5022757ce5'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:12 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:12 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:12 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info" returned: 0 in 0.680s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:12 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info is being set with open permissions: ugo+rw Jul 09 01:35:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:12 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info Jul 09 01:35:12 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:13 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.665s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Deleted volume successfully. Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-930e4866-0e0f-4073-a2a2-45b34417e892 tempest-ProjectReaderTests-796009963 None] Lock "cinder-905fbb61-2e8c-4309-9d03-2ba7598f4049-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:13 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.info" returned: 0 in 0.715s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:13 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-58896c49-4e8c-4606-b837-591aa4908edf tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (1474c336-05db-4d77-9648-675cdc2d638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e506bf8f-59d1-4c63-87df-c42007ff9d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e506bf8f-59d1-4c63-87df-c42007ff9d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659550825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c296c7d-6345-4c5a-92e0-940cb3bde26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:14Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ca6d2a-882f-4ca5-98d3-0fbefde576c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ca6d2a-882f-4ca5-98d3-0fbefde576c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b6db8-331c-4301-afdd-0f694ecb0964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b6db8-331c-4301-afdd-0f694ecb0964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c296c7d-6345-4c5a-92e0-940cb3bde26e', 'volume_name': 'volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204faef9-c343-4318-afb5-ad6ad34b1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204faef9-c343-4318-afb5-ad6ad34b1981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39358b42-85bf-4b3a-bf4a-e90a8e00769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:13 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Volume 5c296c7d-6345-4c5a-92e0-940cb3bde26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e', 'volume_size': 1} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659550825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c296c7d-6345-4c5a-92e0-940cb3bde26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:14Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Creating volume 5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:13 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:14 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e 1073741824 Jul 09 01:35:14 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 23640d9c-80e7-4c2c-80a6-7dc801c0a5dd of volume d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46eaf7c-89f7-4d93-b8cf-9151677c0815]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:14 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd Jul 09 01:35:14 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:14 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e 1073741824" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:14 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e Jul 09 01:35:14 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:15 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66723ee-96e3-47c3-9cca-418386167828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd1f68-4550-41a6-8a78-1f2ccc7c30de]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:15 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 Jul 09 01:35:15 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:15 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e" returned: 0 in 0.670s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39358b42-85bf-4b3a-bf4a-e90a8e00769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6f1da9-9ef8-4ee6-baac-2a84240170b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:15 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Volume volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e (5c296c7d-6345-4c5a-92e0-940cb3bde26e): created successfully Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6f1da9-9ef8-4ee6-baac-2a84240170b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:15 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (1474c336-05db-4d77-9648-675cdc2d638e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6831984b-1b3a-4eb5-932f-8ee43b81c352 tempest-ProjectReaderTests-796009963 None] Created volume successfully. Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Creating offline snapshot 2e305b70-115b-4da4-a9bd-344ace62666d of volume 5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[25376b25-9ad9-4759-bfff-d8b46a2f2f79]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:16 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828" returned: 0 in 0.830s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:16 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd Jul 09 01:35:16 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:16 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e Jul 09 01:35:16 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:16 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:16 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd Jul 09 01:35:16 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:17 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d 1G Jul 09 01:35:17 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:17 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828.23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" returned: 0 in 0.700s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd" released by "_delete_snapshot" :: held 3.183s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" released by "delete_snapshot" :: held 3.209s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Created reservations ['27978b8f-87ae-4d84-ace9-20ad1eb98697', '4dbac15a-0864-4aa9-859a-40c0730825da', 'cfeb0006-c08a-4db4-92ca-c7cc83b9b2ba', '1178e582-8015-45f1-b545-0bc634b7161e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-db0062b6-5811-48d7-8490-65cc44d80b26 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-23640d9c-80e7-4c2c-80a6-7dc801c0a5dd-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:17 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d 1G" returned: 0 in 0.866s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:17 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d Jul 09 01:35:17 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:18 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:18 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d is being set with open permissions: ugo+rw Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:18 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d Jul 09 01:35:18 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-d66723ee-96e3-47c3-9cca-418386167828-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-d66723ee-96e3-47c3-9cca-418386167828-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e754b2-f6f8-40a5-a7d2-ceb505c2c5ba]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:18 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 Jul 09 01:35:18 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:19 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:19 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info Jul 09 01:35:19 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:19 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828" returned: 0 in 0.772s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:19 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828 Jul 09 01:35:19 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:19 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:19 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info is being set with open permissions: ugo+rw Jul 09 01:35:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:19 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info Jul 09 01:35:19 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:20 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-d66723ee-96e3-47c3-9cca-418386167828" returned: 0 in 0.650s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-d66723ee-96e3-47c3-9cca-418386167828" released by "delete_volume" :: held 1.481s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Created reservations ['d1a0a969-3fb7-45df-ba4b-e5b5e2571b4e', 'bfdef49f-f0a3-4ab6-bbb1-56e081c4c843', 'f746e7cd-27b0-439c-b1f0-57e951d970ba', '494c6441-9d8a-476b-8752-79ae53a30d2b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:20 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:20 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:20 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.info" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:20 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-d2b8e1e1-492d-482a-a3d4-9cd2452ded3e tempest-ProjectReaderTests-796009963 None] Create snapshot completed successfully Jul 09 01:35:21 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.690s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:21 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-5afafa5b-338c-434b-b106-ed44a1378ec4 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-d66723ee-96e3-47c3-9cca-418386167828-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-2e305b70-115b-4da4-a9bd-344ace62666d-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (24913e5b-0c4c-4a08-a9e9-3da939ffb355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db7834-6a2f-41b9-a983-a313ea86edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-2e305b70-115b-4da4-a9bd-344ace62666d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db7834-6a2f-41b9-a983-a313ea86edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030295660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ed040-4288-4c7c-827d-d2b939794be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:21Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4126aba-843e-4389-9d4d-54f403fe28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4126aba-843e-4389-9d4d-54f403fe28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3ad802-734f-42d5-bb7b-00f6b87b0eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3ad802-734f-42d5-bb7b-00f6b87b0eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96ed040-4288-4c7c-827d-d2b939794be9', 'volume_name': 'volume-f96ed040-4288-4c7c-827d-d2b939794be9', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb8f1d3-10d0-4462-977c-94df9d8d8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb8f1d3-10d0-4462-977c-94df9d8d8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2d231a-01c8-403e-abb4-8972f534af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:21 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Volume f96ed040-4288-4c7c-827d-d2b939794be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96ed040-4288-4c7c-827d-d2b939794be9', 'volume_size': 1} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030295660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ed040-4288-4c7c-827d-d2b939794be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:21Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Creating volume f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:21 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-2e305b70-115b-4da4-a9bd-344ace62666d" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-2e305b70-115b-4da4-a9bd-344ace62666d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:21 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 1073741824 Jul 09 01:35:21 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Deleting offline snapshot 2e305b70-115b-4da4-a9bd-344ace62666d of volume 5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] snapshot_file for this snap is: volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695b67d-115a-4e18-9c33-913548096783]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:21 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d Jul 09 01:35:21 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:22 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 1073741824" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:22 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d" returned: 0 in 0.796s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:22 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 Jul 09 01:35:22 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b84527-867f-4954-9524-d475d678b656]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:22 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e Jul 09 01:35:22 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:23 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9" returned: 0 in 0.681s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2d231a-01c8-403e-abb4-8972f534af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96ed040-4288-4c7c-827d-d2b939794be9', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c263ddaf-5b4b-42b7-9a45-95e2b4491291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:23 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Volume volume-f96ed040-4288-4c7c-827d-d2b939794be9 (f96ed040-4288-4c7c-827d-d2b939794be9): created successfully Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c263ddaf-5b4b-42b7-9a45-95e2b4491291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (24913e5b-0c4c-4a08-a9e9-3da939ffb355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:23 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-df0a3578-8bed-4570-92df-2dace7929f40 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:35:23 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e" returned: 0 in 0.787s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:23 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d Jul 09 01:35:23 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 31290ca8-f9dc-4aa8-9411-54342692f28e of volume f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b057f2-0e68-45f4-be82-a05c41b96fb4]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:23 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 Jul 09 01:35:23 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:23 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d" returned: 0 in 0.795s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:24 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d Jul 09 01:35:24 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:24 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9" returned: 0 in 0.799s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:24 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e 1G Jul 09 01:35:24 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:24 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e.2e305b70-115b-4da4-a9bd-344ace62666d" returned: 0 in 0.666s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-2e305b70-115b-4da4-a9bd-344ace62666d" released by "_delete_snapshot" :: held 3.141s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" released by "delete_snapshot" :: held 3.168s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Created reservations ['6ba4f1e1-a7b3-4297-98c6-92a9a0a6e6d7', 'a41b23cd-15d6-4b47-9379-95b3bcff6b3e', '52f791ae-3e17-427c-acc7-74460dd450dd', '49851968-410a-4620-8c2b-652f54fd4fe2'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Delete snapshot completed successfully. Jul 09 01:35:24 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-8476b3c7-ef2c-4d0b-b63e-80f91c159184 tempest-ProjectReaderTests-796009963 None] Lock "cinder-2e305b70-115b-4da4-a9bd-344ace62666d-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:25 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e 1G" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ed040-4288-4c7c-827d-d2b939794be9 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:25 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ed040-4288-4c7c-827d-d2b939794be9 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e Jul 09 01:35:25 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-5c296c7d-6345-4c5a-92e0-940cb3bde26e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "cinder-5c296c7d-6345-4c5a-92e0-940cb3bde26e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba7f75-a967-4455-b38c-23db7995ea47]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:25 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e Jul 09 01:35:25 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:26 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ed040-4288-4c7c-827d-d2b939794be9 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e" returned: 0 in 0.722s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:26 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e is being set with open permissions: ugo+rw Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:26 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e Jul 09 01:35:26 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:26 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e" returned: 0 in 0.798s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:26 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e Jul 09 01:35:26 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:26 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:26 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info Jul 09 01:35:26 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:27 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-5c296c7d-6345-4c5a-92e0-940cb3bde26e" returned: 0 in 0.669s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-5c296c7d-6345-4c5a-92e0-940cb3bde26e" released by "delete_volume" :: held 1.536s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Created reservations ['4236887d-1b5d-4ce3-84eb-bcb877730a1a', 'fc72ef85-826b-4fb9-9eff-5a3d73b1ca64', '2cee81bd-8b2e-44d9-8744-765802d700ac', '3bab236e-9f90-43df-ae87-f117bdfb699c'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:27 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:27 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info" returned: 0 in 0.706s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:27 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info is being set with open permissions: ugo+rw Jul 09 01:35:27 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:27 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info Jul 09 01:35:27 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:28 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Deleted volume successfully. Jul 09 01:35:28 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.info" returned: 0 in 0.668s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-2f1faf0c-e281-4532-b3e8-df32a481237a tempest-ProjectReaderTests-796009963 None] Lock "cinder-5c296c7d-6345-4c5a-92e0-940cb3bde26e-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bc8750e8-2dd0-4f96-bde1-319590142907 tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (9dffca2d-e924-40eb-a25d-571d6e80c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2931dc28-0873-4f17-b9c7-e144bbd31bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2931dc28-0873-4f17-b9c7-e144bbd31bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54277599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600e058a-dbb5-4db2-93ec-f1067ef64a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:28Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4df310-6afe-4a0b-b399-e81facf248e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4df310-6afe-4a0b-b399-e81facf248e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39c214b-3f6f-4fbc-b5e7-46576a2991a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39c214b-3f6f-4fbc-b5e7-46576a2991a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600e058a-dbb5-4db2-93ec-f1067ef64a5c', 'volume_name': 'volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079c0923-3a52-45b0-9641-b72bd4c093c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079c0923-3a52-45b0-9641-b72bd4c093c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938bd624-1720-472b-9d05-8d51f02b05e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:28 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Volume 600e058a-dbb5-4db2-93ec-f1067ef64a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c', 'volume_size': 1} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54277599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600e058a-dbb5-4db2-93ec-f1067ef64a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:28Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Creating volume 600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:28 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:28 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c 1073741824 Jul 09 01:35:28 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-31290ca8-f9dc-4aa8-9411-54342692f28e-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-31290ca8-f9dc-4aa8-9411-54342692f28e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-31290ca8-f9dc-4aa8-9411-54342692f28e" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-31290ca8-f9dc-4aa8-9411-54342692f28e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 31290ca8-f9dc-4aa8-9411-54342692f28e of volume f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49394708-a05f-4533-a630-07c032e5d0d0]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:29 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e Jul 09 01:35:29 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:29 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c 1073741824" returned: 0 in 0.883s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:29 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c Jul 09 01:35:29 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:29 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ed040-4288-4c7c-827d-d2b939794be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecdf8be-53fd-4745-8d30-3b4ee1a91d88]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:29 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 Jul 09 01:35:29 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:30 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938bd624-1720-472b-9d05-8d51f02b05e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1706d823-7e4e-4067-91bb-ec1095a0e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:30 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Volume volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c (600e058a-dbb5-4db2-93ec-f1067ef64a5c): created successfully Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1706d823-7e4e-4067-91bb-ec1095a0e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (9dffca2d-e924-40eb-a25d-571d6e80c67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-9d8cde2d-3f53-4e3a-8992-b28f5374e846 tempest-ProjectReaderTests-796009963 None] Created volume successfully. Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Creating offline snapshot 9f36ec4f-371f-46d2-bd31-3daf085cf725 of volume 600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de74eaf-f639-43c7-bcfa-94e1bcbcc045]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:30 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:30 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e Jul 09 01:35:30 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:30 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c Jul 09 01:35:30 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:31 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e" returned: 0 in 0.748s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:31 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e Jul 09 01:35:31 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:31 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:31 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:31 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 1G Jul 09 01:35:31 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:32 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9.31290ca8-f9dc-4aa8-9411-54342692f28e" returned: 0 in 0.661s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-31290ca8-f9dc-4aa8-9411-54342692f28e" released by "_delete_snapshot" :: held 3.121s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" released by "delete_snapshot" :: held 3.142s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Created reservations ['fdb0e05b-5d73-4523-8170-159ce1a80705', '376752f7-d297-41d2-a486-4ea570140a6d', 'a66a4e2a-fae7-4100-a124-6fea8b5d2ae5', '578ee150-867b-4a9e-ad06-0fa5388617fa'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:32 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4970463f-11cd-41c1-a7e7-09f2f0e3c18e tempest-ProjectMemberTests-1209260408 None] Lock "cinder-31290ca8-f9dc-4aa8-9411-54342692f28e-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:32 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 1G" returned: 0 in 0.845s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:32 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 Jul 09 01:35:32 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:32 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725" returned: 0 in 0.722s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:32 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 is being set with open permissions: ugo+rw Jul 09 01:35:32 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:33 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 Jul 09 01:35:33 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-f96ed040-4288-4c7c-827d-d2b939794be9-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f96ed040-4288-4c7c-827d-d2b939794be9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a30ddf-c372-4fde-b05b-676625045c4a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:33 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 Jul 09 01:35:33 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:33 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:33 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info Jul 09 01:35:33 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:33 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:33 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:34 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9" returned: 0 in 0.801s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:34 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9 Jul 09 01:35:34 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:34 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info" returned: 0 in 0.721s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:34 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info is being set with open permissions: ugo+rw Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:34 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info Jul 09 01:35:34 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:34 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.671s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:35:34 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f96ed040-4288-4c7c-827d-d2b939794be9" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f96ed040-4288-4c7c-827d-d2b939794be9" released by "delete_volume" :: held 1.563s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Created reservations ['dcde2aaa-804e-471f-9677-6343631503ba', '332ec4f9-e196-42ae-bb81-e477595809d6', '06c29dc7-539f-466e-8aee-89b6a8268252', 'f3962b46-2e7e-4b21-8a3c-e09c410c20ed'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:34 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:34 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:35 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.info" returned: 0 in 0.674s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-39d00c27-fcc6-444e-b285-c55647cd934c tempest-ProjectReaderTests-796009963 None] Create snapshot completed successfully Jul 09 01:35:35 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.673s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:35 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-0c7aded0-7e4c-404e-adc4-2d14a903837c tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f96ed040-4288-4c7c-827d-d2b939794be9-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-9f36ec4f-371f-46d2-bd31-3daf085cf725-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (f1179318-bc24-4826-81b4-5e6f32707287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b439f199-ab4b-4a2c-b616-6ab61d7ed85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b439f199-ab4b-4a2c-b616-6ab61d7ed85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685153702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:36Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987f9a0d-1b3d-4b89-8161-a898f5770b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987f9a0d-1b3d-4b89-8161-a898f5770b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914a6a34-1c46-47d0-b5a5-92a8dc654bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914a6a34-1c46-47d0-b5a5-92a8dc654bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5', 'volume_name': 'volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9302d953-5ed8-4ed6-90e4-d98f4220e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9302d953-5ed8-4ed6-90e4-d98f4220e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8c461d-205a-4b24-99dc-1c3db56d8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:35 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Volume 714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5', 'volume_size': 1} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685153702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:36Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Creating volume 714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:35 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-9f36ec4f-371f-46d2-bd31-3daf085cf725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.131s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-9f36ec4f-371f-46d2-bd31-3daf085cf725" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:35 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 1073741824 Jul 09 01:35:35 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-9f36ec4f-371f-46d2-bd31-3daf085cf725" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:35 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Deleting offline snapshot 9f36ec4f-371f-46d2-bd31-3daf085cf725 of volume 600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] snapshot_file for this snap is: volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22bd126-9ee3-4d3a-9fd4-f1f3ee4a229f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:36 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 Jul 09 01:35:36 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:36 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 1073741824" returned: 0 in 0.844s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:36 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725" returned: 0 in 0.815s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:36 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 Jul 09 01:35:36 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ac96e-035a-465b-b10c-34671eceb0ce]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:36 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:36 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c Jul 09 01:35:36 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:37 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" returned: 0 in 0.675s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:INSERT=41,cinder:UPDATE=134,cinder:SELECT=102,cinder:DELETE=14 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8c461d-205a-4b24-99dc-1c3db56d8dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a95e48-a6f2-439d-b1fb-109f63fa634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=115,cinder:INSERT=36,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:35:37 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Volume volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 (714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5): created successfully Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a95e48-a6f2-439d-b1fb-109f63fa634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (f1179318-bc24-4826-81b4-5e6f32707287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:37 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-53b27a15-2650-4dd4-8a40-75c5f4091018 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:35:37 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c" returned: 0 in 0.778s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:37 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:37 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 Jul 09 01:35:37 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 2a35c211-6544-49b4-a3fc-1e264e639a81 of volume 714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597b082-3764-414f-8617-ad1abca02440]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:38 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 Jul 09 01:35:38 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:38 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725" returned: 0 in 0.758s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:38 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725 Jul 09 01:35:38 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:38 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" returned: 0 in 0.829s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:38 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:38 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 1G Jul 09 01:35:38 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:39 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c.9f36ec4f-371f-46d2-bd31-3daf085cf725" returned: 0 in 0.680s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-9f36ec4f-371f-46d2-bd31-3daf085cf725" released by "_delete_snapshot" :: held 3.137s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" released by "delete_snapshot" :: held 3.162s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Created reservations ['d5111067-e834-44ae-99d9-11a40498a98e', 'eed0dbfe-379f-46f4-9f74-225c5b9469c3', '8f13137d-c922-4c7e-a21e-e3b19487ed4e', '68478fd0-0a64-4714-93b1-5c717b5d1252'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:39 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Delete snapshot completed successfully. Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-4599e075-d5b7-407e-b63f-cae182e32872 tempest-ProjectReaderTests-796009963 None] Lock "cinder-9f36ec4f-371f-46d2-bd31-3daf085cf725-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:39 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 1G" returned: 0 in 0.824s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:39 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:39 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 Jul 09 01:35:39 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-600e058a-dbb5-4db2-93ec-f1067ef64a5c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "cinder-600e058a-dbb5-4db2-93ec-f1067ef64a5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[55082fbc-93de-4d89-96c3-5b89a0f2cb6b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:40 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c Jul 09 01:35:40 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:40 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81" returned: 0 in 0.754s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:40 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 is being set with open permissions: ugo+rw Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:40 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 Jul 09 01:35:40 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:40 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c" returned: 0 in 0.777s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:40 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:40 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c Jul 09 01:35:40 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:41 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81" returned: 0 in 0.662s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:41 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info Jul 09 01:35:41 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:41 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-600e058a-dbb5-4db2-93ec-f1067ef64a5c" returned: 0 in 0.681s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-600e058a-dbb5-4db2-93ec-f1067ef64a5c" released by "delete_volume" :: held 1.521s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Created reservations ['744536bd-85c1-4521-a573-991580a19d3a', 'bd61f2e0-1014-419f-9d5a-25f6f0eb0ed6', 'd7449c0d-f816-478b-b74c-a36d8faced3c', '1eb2aba1-140e-4712-8231-44de76e32b8a'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:41 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:41 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:41 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:41 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info is being set with open permissions: ugo+rw Jul 09 01:35:41 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:41 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info Jul 09 01:35:41 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:42 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.713s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Deleted volume successfully. Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6472ca5-2b2d-4c07-b435-4937ee5d004f tempest-ProjectReaderTests-796009963 None] Lock "cinder-600e058a-dbb5-4db2-93ec-f1067ef64a5c-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:42 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.info" returned: 0 in 0.692s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.512s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:42 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4f906852-04d1-44bb-904a-a6107af3a418 tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (c2a6484b-381c-4e8b-9d43-15e623270a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322b2142-8aa1-4c05-ae63-d356efb674e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322b2142-8aa1-4c05-ae63-d356efb674e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840129098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68660e78-4c2e-4fff-9351-b46ce4427bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:43Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc1298-3faf-46b5-95dc-e2e629f097ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc1298-3faf-46b5-95dc-e2e629f097ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4065817-5f84-429a-a821-9634698fef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4065817-5f84-429a-a821-9634698fef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68660e78-4c2e-4fff-9351-b46ce4427bd1', 'volume_name': 'volume-68660e78-4c2e-4fff-9351-b46ce4427bd1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42a7688-02e4-422c-af95-15bed791d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42a7688-02e4-422c-af95-15bed791d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15290e1-eb4f-4ae9-a25b-7d498b54bb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Volume 68660e78-4c2e-4fff-9351-b46ce4427bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68660e78-4c2e-4fff-9351-b46ce4427bd1', 'volume_size': 1} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840129098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68660e78-4c2e-4fff-9351-b46ce4427bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddc28032061442a8cc92a9b7bd078ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:43Z,use_quota=True,user_id='be217d3333ac41be997d0f736ac24eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Creating volume 68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:42 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:42 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 1073741824 Jul 09 01:35:42 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-2a35c211-6544-49b4-a3fc-1e264e639a81-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-2a35c211-6544-49b4-a3fc-1e264e639a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-2a35c211-6544-49b4-a3fc-1e264e639a81" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-2a35c211-6544-49b4-a3fc-1e264e639a81" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 2a35c211-6544-49b4-a3fc-1e264e639a81 of volume 714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0856aa-6792-4344-9933-f2f18fd6048f]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:43 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 Jul 09 01:35:43 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:43 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 1073741824" returned: 0 in 0.859s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:43 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 Jul 09 01:35:43 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:44 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be0fcd-6d68-4eb8-ab1b-fdb00602fe4b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:44 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 Jul 09 01:35:44 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:44 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15290e1-eb4f-4ae9-a25b-7d498b54bb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68660e78-4c2e-4fff-9351-b46ce4427bd1', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96aae4-5b1b-4d2f-9232-ea9ca3f0b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:44 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Volume volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 (68660e78-4c2e-4fff-9351-b46ce4427bd1): created successfully Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96aae4-5b1b-4d2f-9232-ea9ca3f0b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Flow 'volume_create_manager' (c2a6484b-381c-4e8b-9d43-15e623270a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:44 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-35c49689-bf14-452e-82cb-da8b74c45363 tempest-ProjectReaderTests-796009963 None] Created volume successfully. Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Creating offline snapshot bd88ab80-e35b-4dbb-824b-60ccbd669076 of volume 68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34cacc-c32c-4998-876b-b7968c63b867]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:45 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" returned: 0 in 0.818s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:45 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 Jul 09 01:35:45 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:45 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 Jul 09 01:35:45 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:45 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:45 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1" returned: 0 in 0.772s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:45 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81 Jul 09 01:35:45 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:45 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 1G Jul 09 01:35:45 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:46 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5.2a35c211-6544-49b4-a3fc-1e264e639a81" returned: 0 in 0.689s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-2a35c211-6544-49b4-a3fc-1e264e639a81" released by "_delete_snapshot" :: held 3.157s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" released by "delete_snapshot" :: held 3.180s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Created reservations ['cbed0f0d-13b8-4f52-85ab-13b9f929e839', 'de0b2eed-07d4-4cd5-874e-1086c6cfd08b', 'c4a84b84-bb91-4027-ba39-dc216a413ef1', 'c41d2e05-4757-4b8f-a552-a420ce1c6e75'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:46 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 1G" returned: 0 in 0.819s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:35:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-efaa9834-8cb6-467b-a3b2-772196578208 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-2a35c211-6544-49b4-a3fc-1e264e639a81-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:46 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 Jul 09 01:35:46 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:47 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076" returned: 0 in 0.709s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:47 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 is being set with open permissions: ugo+rw Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 Jul 09 01:35:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4a094-fd6e-4a11-9e9b-1f7715dbc50d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:47 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 Jul 09 01:35:47 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:47 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:48 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info Jul 09 01:35:48 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:48 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" returned: 0 in 0.817s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:48 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5 Jul 09 01:35:48 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:48 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info" returned: 0 in 0.742s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:48 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info is being set with open permissions: ugo+rw Jul 09 01:35:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:48 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info Jul 09 01:35:48 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:49 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" returned: 0 in 0.705s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5" released by "delete_volume" :: held 1.586s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Created reservations ['0bacceaf-6945-458a-a2fd-ea26fef3f48b', '06c8304f-a38e-4244-b8f8-11183e350422', 'b4105b77-10ed-4161-b036-38667cb571e2', '10381e0b-6c4a-4ee1-9f40-021bcc64c7f8'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:49 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:49 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:49 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.info" returned: 0 in 0.682s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.474s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:49 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-94357482-62af-40da-a919-4e0e7776e871 tempest-ProjectReaderTests-796009963 None] Create snapshot completed successfully Jul 09 01:35:50 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:50 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-b1295a64-53de-469a-a472-eb0e2994e164 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-714c1c9a-c79f-4ab9-b6e2-1ed17a6299f5-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (d11cfd33-3a58-43d8-bedd-3935604a0dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8c4b6f-387f-44a9-b54b-0fa3f2fcd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-bd88ab80-e35b-4dbb-824b-60ccbd669076-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8c4b6f-387f-44a9-b54b-0fa3f2fcd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471426002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f248c0-f4aa-473e-a519-9f82f039e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:50Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3743ffc6-7778-4ddd-adc4-6f24b454102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3743ffc6-7778-4ddd-adc4-6f24b454102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a95c77-d995-4bf4-bc41-70857e5fc573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a95c77-d995-4bf4-bc41-70857e5fc573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f248c0-f4aa-473e-a519-9f82f039e7d6', 'volume_name': 'volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f53732-35e6-43f4-864c-8659fec271f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f53732-35e6-43f4-864c-8659fec271f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc16f169-a2bc-44a2-9892-a501fb877ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:50 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Volume e8f248c0-f4aa-473e-a519-9f82f039e7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6', 'volume_size': 1} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471426002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f248c0-f4aa-473e-a519-9f82f039e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:35:50Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Creating volume e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:35:50 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-bd88ab80-e35b-4dbb-824b-60ccbd669076-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:50 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 1073741824 Jul 09 01:35:50 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-bd88ab80-e35b-4dbb-824b-60ccbd669076" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-bd88ab80-e35b-4dbb-824b-60ccbd669076" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Deleting offline snapshot bd88ab80-e35b-4dbb-824b-60ccbd669076 of volume 68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] snapshot_file for this snap is: volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf2f5f-435f-41ba-bab2-649b902575a7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:50 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 Jul 09 01:35:50 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:51 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076" returned: 0 in 0.802s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68660e78-4c2e-4fff-9351-b46ce4427bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:51 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 1073741824" returned: 0 in 0.914s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2f1d61-3837-4566-82b9-8c4c515bb91d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:51 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 Jul 09 01:35:51 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:51 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 Jul 09 01:35:51 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:51 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:51 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc16f169-a2bc-44a2-9892-a501fb877ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a82d33-f872-46e5-a070-dcdc89d8b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:35:52 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Volume volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 (e8f248c0-f4aa-473e-a519-9f82f039e7d6): created successfully Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a82d33-f872-46e5-a070-dcdc89d8b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (d11cfd33-3a58-43d8-bedd-3935604a0dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:35:52 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-4192d73a-f675-4e67-8216-5bc1934df832 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:35:52 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1" returned: 0 in 0.800s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:52 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 Jul 09 01:35:52 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 8ab3023f-c5f5-475f-ac54-d6fbd2af83cf of volume e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd70f0-ceea-4247-a516-8751ba067b2c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:52 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 Jul 09 01:35:52 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:52 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076" returned: 0 in 0.790s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:52 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:52 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076 Jul 09 01:35:52 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:53 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6" returned: 0 in 0.808s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:53 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf 1G Jul 09 01:35:53 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:53 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1.bd88ab80-e35b-4dbb-824b-60ccbd669076" returned: 0 in 0.680s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-bd88ab80-e35b-4dbb-824b-60ccbd669076" released by "_delete_snapshot" :: held 3.177s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" released by "delete_snapshot" :: held 3.198s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Created reservations ['c6f8ad39-a82d-4a25-9a64-b3c0053a1add', '0a3a5cc3-4651-42e1-a36c-352cfe32cc23', 'ab9318b1-5a52-47e0-ad06-517b0e83a0ac', '0c90d8b0-2755-4f8c-bdec-8881d4535bd1'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:53 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Delete snapshot completed successfully. Jul 09 01:35:53 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-e4a5175b-3859-4d73-9789-4cb3fb14105a tempest-ProjectReaderTests-796009963 None] Lock "cinder-bd88ab80-e35b-4dbb-824b-60ccbd669076-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:54 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf 1G" returned: 0 in 0.811s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:54 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf Jul 09 01:35:54 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-68660e78-4c2e-4fff-9351-b46ce4427bd1-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "cinder-68660e78-4c2e-4fff-9351-b46ce4427bd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Acquiring lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" acquired by "delete_volume" :: waited 0.017s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed49bd8-9d9c-40c8-8d0d-6e9d6228f8b9]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:54 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 Jul 09 01:35:54 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:54 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:54 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf is being set with open permissions: ugo+rw Jul 09 01:35:54 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:54 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf Jul 09 01:35:54 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:55 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1" returned: 0 in 0.781s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:55 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1 Jul 09 01:35:55 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:55 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" returned: 0 in 0.676s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:55 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:55 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info Jul 09 01:35:55 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:56 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-68660e78-4c2e-4fff-9351-b46ce4427bd1" returned: 0 in 0.660s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "cinder-quobyte-68660e78-4c2e-4fff-9351-b46ce4427bd1" released by "delete_volume" :: held 1.503s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Created reservations ['621b950b-33ab-4c1c-acb2-3c3d83b89435', '6e5b255f-95ff-4247-896d-78e891360828', 'a2956f28-4d62-49db-89de-47969666344b', '6d3891e9-5272-42b6-bd06-7656b7076b2d'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:35:56 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info" returned: 0 in 0.677s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:56 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info is being set with open permissions: ugo+rw Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:56 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:35:56 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:56 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info Jul 09 01:35:56 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:56 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.659s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:35:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Deleted volume successfully. Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-19fb42c0-485c-4603-9d6a-4bcb6db32b52 tempest-ProjectReaderTests-796009963 None] Lock "cinder-68660e78-4c2e-4fff-9351-b46ce4427bd1-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:35:56 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.info" returned: 0 in 0.697s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:56 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.493s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:35:56 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f24093a2-79fe-482b-b67c-8c5c1438e20c tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 8ab3023f-c5f5-475f-ac54-d6fbd2af83cf of volume e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf9e90b-d516-432f-8b30-95d82225106e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:57 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:57 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf Jul 09 01:35:57 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:58 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" returned: 0 in 0.810s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:58 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:35:58 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea881430-da53-4cac-a470-9099003efb61]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:35:58 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:58 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 Jul 09 01:35:58 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:35:59 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 09 01:35:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6" returned: 0 in 0.757s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:35:59 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:35:59 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf Jul 09 01:35:59 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:00 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" returned: 0 in 0.728s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:00 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf Jul 09 01:36:00 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:00 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6.8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" returned: 0 in 0.635s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf" released by "_delete_snapshot" :: held 3.027s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" released by "delete_snapshot" :: held 3.052s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Created reservations ['be9e92f1-36f0-4b31-967e-035c24eedabe', '37ea5e2f-9648-4f5d-ba01-7084d12c563b', '3e5e6fe0-e610-4572-ac42-e65516a47cf6', 'cdf005fb-86ae-428c-b5d3-cc1643359bc3'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:00 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:36:00 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-a6d607fb-5ec6-4fea-b8d8-babd54852a3d tempest-ProjectMemberTests-1209260408 None] Lock "cinder-8ab3023f-c5f5-475f-ac54-d6fbd2af83cf-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-e8f248c0-f4aa-473e-a519-9f82f039e7d6-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-e8f248c0-f4aa-473e-a519-9f82f039e7d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:01 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:02 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b688e3-02fa-42b2-9e49-8bd72654b58c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:02 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 Jul 09 01:36:02 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:02 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6" returned: 0 in 0.797s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:02 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:02 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6 Jul 09 01:36:02 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:03 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-e8f248c0-f4aa-473e-a519-9f82f039e7d6" returned: 0 in 0.643s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-e8f248c0-f4aa-473e-a519-9f82f039e7d6" released by "delete_volume" :: held 1.502s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Created reservations ['f74b4a6c-882f-4911-bc3f-40df27361a39', 'c76b05ec-20c6-4bb8-a8be-2703ce76124d', 'a1fcfc5b-01c4-4867-a43d-94fe1f9fc968', '5a767fa5-11af-4322-972c-85fcfd28422e'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:03 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:03 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:03 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:04 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.653s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:04 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-299dcf52-f9f4-48dc-9e8e-ff944e092a65 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-e8f248c0-f4aa-473e-a519-9f82f039e7d6-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (6cb81183-29d8-40fa-be83-7e17a0e03bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b0cbd3-d7e4-4474-b6c0-a9d42e52ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b0cbd3-d7e4-4474-b6c0-a9d42e52ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981706688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93eb07b-3227-4d6b-bf20-9debebc8428e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:05Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9884bf-5e0c-4ccf-a557-f431285083c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9884bf-5e0c-4ccf-a557-f431285083c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6518b4f-5992-46a3-b940-5afd81739472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6518b4f-5992-46a3-b940-5afd81739472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93eb07b-3227-4d6b-bf20-9debebc8428e', 'volume_name': 'volume-f93eb07b-3227-4d6b-bf20-9debebc8428e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a20c5-9934-4c02-a7fc-c490d4ffcd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790a20c5-9934-4c02-a7fc-c490d4ffcd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e9b80-f1d4-4a11-9107-2795bb48d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:04 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Volume f93eb07b-3227-4d6b-bf20-9debebc8428e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93eb07b-3227-4d6b-bf20-9debebc8428e', 'volume_size': 1} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981706688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93eb07b-3227-4d6b-bf20-9debebc8428e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:05Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Creating volume f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:36:04 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:36:04 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:04 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e 1073741824 Jul 09 01:36:04 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:05 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e 1073741824" returned: 0 in 0.801s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:05 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:05 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e Jul 09 01:36:05 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:06 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e" returned: 0 in 0.622s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e9b80-f1d4-4a11-9107-2795bb48d230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93eb07b-3227-4d6b-bf20-9debebc8428e', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a91f0ef-db42-4fb8-98d5-feab8bcf1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:06 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Volume volume-f93eb07b-3227-4d6b-bf20-9debebc8428e (f93eb07b-3227-4d6b-bf20-9debebc8428e): created successfully Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a91f0ef-db42-4fb8-98d5-feab8bcf1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (6cb81183-29d8-40fa-be83-7e17a0e03bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:06 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-6f878c07-a6d1-40b6-8e27-982074fb07e3 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 01a8a44c-6fc5-496b-8b97-779ba85a5b2b of volume f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4e686c-fbcd-47bd-8895-7a707600b41c]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:06 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:06 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e Jul 09 01:36:06 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:07 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e" returned: 0 in 0.732s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:07 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:07 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b 1G Jul 09 01:36:07 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:08 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b 1G" returned: 0 in 0.779s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:08 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93eb07b-3227-4d6b-bf20-9debebc8428e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:08 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93eb07b-3227-4d6b-bf20-9debebc8428e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b Jul 09 01:36:08 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f93eb07b-3227-4d6b-bf20-9debebc8428e -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b" returned: 0 in 0.663s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:09 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b is being set with open permissions: ugo+rw Jul 09 01:36:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:09 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b Jul 09 01:36:09 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:09 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b" returned: 0 in 0.628s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:09 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:09 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info Jul 09 01:36:09 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:10 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info" returned: 0 in 0.628s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:10 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info is being set with open permissions: ugo+rw Jul 09 01:36:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:10 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info Jul 09 01:36:10 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:10 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.info" returned: 0 in 0.644s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:10 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:10 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-99682eaf-1441-413b-9523-1711b10c9f7f tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-01a8a44c-6fc5-496b-8b97-779ba85a5b2b-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-01a8a44c-6fc5-496b-8b97-779ba85a5b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-01a8a44c-6fc5-496b-8b97-779ba85a5b2b" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-01a8a44c-6fc5-496b-8b97-779ba85a5b2b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 01a8a44c-6fc5-496b-8b97-779ba85a5b2b of volume f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1dc7d4-22b1-43be-9971-a580f6867269]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:12 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b Jul 09 01:36:12 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:12 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b" returned: 0 in 0.743s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f93eb07b-3227-4d6b-bf20-9debebc8428e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c3d67-fd2a-4e20-accb-ecfd4e7c867e]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:12 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:12 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e Jul 09 01:36:12 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:13 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e" returned: 0 in 0.750s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:13 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:13 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b Jul 09 01:36:13 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:14 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b" returned: 0 in 0.726s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:14 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:14 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b Jul 09 01:36:14 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:15 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e.01a8a44c-6fc5-496b-8b97-779ba85a5b2b" returned: 0 in 0.650s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-01a8a44c-6fc5-496b-8b97-779ba85a5b2b" released by "_delete_snapshot" :: held 2.961s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" released by "delete_snapshot" :: held 2.980s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Created reservations ['63b9836e-0641-4ee9-99d4-7dc39687b846', 'b27afd89-12ab-4465-9f7b-5add219bda06', '8554924b-f6cc-4bc4-a933-3805ef60cef9', '2b3a744c-c47b-4f73-a2d4-37768ffc1a36'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:15 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-ed1aaa3e-f164-437a-a97b-5b643b7de741 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-01a8a44c-6fc5-496b-8b97-779ba85a5b2b-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-f93eb07b-3227-4d6b-bf20-9debebc8428e-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f93eb07b-3227-4d6b-bf20-9debebc8428e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" acquired by "delete_volume" :: waited 0.015s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70a3ca-e0e9-40fc-aa84-2caec4396bd1]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:15 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:15 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e Jul 09 01:36:15 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:16 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e" returned: 0 in 0.785s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:16 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e Jul 09 01:36:16 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:16 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f93eb07b-3227-4d6b-bf20-9debebc8428e" returned: 0 in 0.643s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f93eb07b-3227-4d6b-bf20-9debebc8428e" released by "delete_volume" :: held 1.487s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Created reservations ['29394191-bd0e-4884-973b-cb24500985b9', '8953e919-fe5f-4d0d-80c7-2dbea4046aef', '6b6266a7-dd3d-4a8a-9b78-161a8b737e27', 'ad58e473-81a7-407a-870f-c9e252016a41'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:16 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:16 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:16 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:17 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.658s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:17 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-bfb980b5-0f46-44ce-ab07-1d08afe3ab5f tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f93eb07b-3227-4d6b-bf20-9debebc8428e-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (0054495b-050a-4ef7-8cf3-a3ed1fad3d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6edff4-e1b6-4b9e-8d5e-905d27b4ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6edff4-e1b6-4b9e-8d5e-905d27b4ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258269361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5229ab7-64e7-4663-9aeb-538ed6373dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:18Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba94374e-9816-47b9-8783-45110d028fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba94374e-9816-47b9-8783-45110d028fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2c722b-9c8c-4991-b2f1-8f5553259b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2c722b-9c8c-4991-b2f1-8f5553259b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5229ab7-64e7-4663-9aeb-538ed6373dbc', 'volume_name': 'volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baa0856-adc8-4372-be59-2c3fde28d337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baa0856-adc8-4372-be59-2c3fde28d337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba13cd4-b7dc-464e-9b0f-f6831126894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:17 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Volume f5229ab7-64e7-4663-9aeb-538ed6373dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc', 'volume_size': 1} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258269361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5229ab7-64e7-4663-9aeb-538ed6373dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d4ab7b14a34125ba5e6a75891533fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:18Z,use_quota=True,user_id='0362368e4b004e9aade8f3cfcbf85be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Creating volume f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:36:17 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:36:17 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:17 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc 1073741824 Jul 09 01:36:17 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:18 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc 1073741824" returned: 0 in 0.820s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:18 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:18 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc Jul 09 01:36:18 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:19 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc" returned: 0 in 0.637s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba13cd4-b7dc-464e-9b0f-f6831126894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4291245-5376-469b-810e-a81d1f285d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:19 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Volume volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc (f5229ab7-64e7-4663-9aeb-538ed6373dbc): created successfully Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4291245-5376-469b-810e-a81d1f285d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:19 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Flow 'volume_create_manager' (0054495b-050a-4ef7-8cf3-a3ed1fad3d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:19 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-f7a86c76-891c-4b6b-98eb-ebb001121368 tempest-ProjectMemberTests-1209260408 None] Created volume successfully. Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Creating offline snapshot 66103151-ca7f-4ae0-84e2-d76640f79670 of volume f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aedf3d4-3907-4542-a91b-0a593baa8ae7]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:20 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc Jul 09 01:36:20 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:20 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc" returned: 0 in 0.733s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:20 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 1G {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:20 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 1G Jul 09 01:36:20 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:21 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 1G" returned: 0 in 0.770s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:21 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:21 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 Jul 09 01:36:21 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:22 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc -F qcow2 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670" returned: 0 in 0.655s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:22 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 is being set with open permissions: ugo+rw Jul 09 01:36:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:22 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 Jul 09 01:36:22 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:22 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670" returned: 0 in 0.632s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:22 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:22 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info Jul 09 01:36:22 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:23 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info" returned: 0 in 0.631s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:23 devstack cinder-volume[86954]: WARNING cinder.volume.drivers.remotefs [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info is being set with open permissions: ugo+rw Jul 09 01:36:23 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:23 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info Jul 09 01:36:23 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:24 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.info" returned: 0 in 0.633s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:24 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.131s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:24 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-74eb8e95-2be2-4945-879e-1978d9d31791 tempest-ProjectMemberTests-1209260408 None] Create snapshot completed successfully Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-66103151-ca7f-4ae0-84e2-d76640f79670-delete_snapshot" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-66103151-ca7f-4ae0-84e2-d76640f79670-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" by "delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-66103151-ca7f-4ae0-84e2-d76640f79670" by "_delete_snapshot" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-66103151-ca7f-4ae0-84e2-d76640f79670" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Deleting offline snapshot 66103151-ca7f-4ae0-84e2-d76640f79670 of volume f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] snapshot_file for this snap is: volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55f08a-1396-4cdd-a1d9-bb940069837d]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:25 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:25 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 Jul 09 01:36:25 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:26 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670" returned: 0 in 0.731s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86954) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb50287-9913-4492-95c6-5b95d8135f4b]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:26 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc Jul 09 01:36:26 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:26 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc" returned: 0 in 0.734s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:26 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:26 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 Jul 09 01:36:26 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:27 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:27 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:27 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670 Jul 09 01:36:27 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:28 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc.66103151-ca7f-4ae0-84e2-d76640f79670" returned: 0 in 0.668s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-66103151-ca7f-4ae0-84e2-d76640f79670" released by "_delete_snapshot" :: held 2.922s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" released by "delete_snapshot" :: held 2.943s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Created reservations ['fae56251-16b7-4db8-8fb9-019e21482d75', '10b4ea7e-2f95-45f2-a0c6-91337f307b1c', '9caa6878-dc4e-4972-bede-09140b1ba0c9', '10f2113e-439b-47cd-919c-72cd6a8ded54'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:28 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Delete snapshot completed successfully. Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-27ce2c28-5d5f-479b-b42b-dd6e9c7e30fc tempest-ProjectMemberTests-1209260408 None] Lock "cinder-66103151-ca7f-4ae0-84e2-d76640f79670-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-f5229ab7-64e7-4663-9aeb-538ed6373dbc-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f5229ab7-64e7-4663-9aeb-538ed6373dbc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" acquired by "delete_volume" :: waited 0.014s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf65cf-f19b-48d5-bbef-8190e5537623]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:28 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:28 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc Jul 09 01:36:28 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:29 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc" returned: 0 in 0.769s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:29 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:29 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc Jul 09 01:36:29 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:30 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-f5229ab7-64e7-4663-9aeb-538ed6373dbc" returned: 0 in 0.651s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-quobyte-f5229ab7-64e7-4663-9aeb-538ed6373dbc" released by "delete_volume" :: held 1.480s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Created reservations ['8aa98cbe-758e-4edf-aabf-96e00353318b', 'ebd1660f-216d-41c9-95fb-30c3b4c227d1', 'c90b0455-6264-440d-9220-8b50e58bfac2', '3b3a082d-2f27-4d67-b556-a0c8618f774b'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:30 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:30 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:30 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.652s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:30 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Deleted volume successfully. Jul 09 01:36:30 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-78fd63bf-732d-47f8-a6ce-d919f935c2f0 tempest-ProjectMemberTests-1209260408 None] Lock "cinder-f5229ab7-64e7-4663-9aeb-538ed6373dbc-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:33 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:33 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:33 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:34 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:34 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.685s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:34 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:34 devstack cinder-volume[86954]: DEBUG oslo_service.periodic_task [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] Running periodic task VolumeManager._thread_info {{(pid=86954) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 01:36:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread count: 28 {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 01:36:34 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e031f870-402b-462a-b793-bfb8cabc7e03 None None] thread info: [<_MainThread(MainThread, started 134761974587520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86954) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 01:36:40 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=110,cinder:DELETE=8,cinder:SELECT=77,cinder:INSERT=29 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:36:40 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:UPDATE=93,cinder:SELECT=79,cinder:INSERT=28,cinder:DELETE=8 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Flow 'volume_create_manager' (0f9f35ed-f021-44b2-a3b7-48f1f162decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893548fb-0c02-4acb-bfb4-88cb3fdc8d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893548fb-0c02-4acb-bfb4-88cb3fdc8d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148979039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82d6112-03fa-429a-bf1f-c974d2ac67b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a320f71f1dd7416dbc5fc27137cf21b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:42Z,use_quota=True,user_id='2f2f6793085d4afe92b4fbb5ad813777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe91ccd-0906-415b-b74f-9ba7338b91e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe91ccd-0906-415b-b74f-9ba7338b91e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f3b93a-b396-4e6a-97d9-8bdb4b3ecc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f3b93a-b396-4e6a-97d9-8bdb4b3ecc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82d6112-03fa-429a-bf1f-c974d2ac67b7', 'volume_name': 'volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa48c8-f49b-4c95-b0c1-9ce4ad5a71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa48c8-f49b-4c95-b0c1-9ce4ad5a71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80459728-fabd-4292-a5eb-15866511f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:42 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Volume b82d6112-03fa-429a-bf1f-c974d2ac67b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7', 'volume_size': 1} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148979039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82d6112-03fa-429a-bf1f-c974d2ac67b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a320f71f1dd7416dbc5fc27137cf21b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:42Z,use_quota=True,user_id='2f2f6793085d4afe92b4fbb5ad813777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Creating volume b82d6112-03fa-429a-bf1f-c974d2ac67b7 {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:36:42 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:42 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 1073741824 Jul 09 01:36:42 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:42 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 1073741824" returned: 0 in 0.806s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:42 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:43 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 Jul 09 01:36:43 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:43 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7" returned: 0 in 0.619s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80459728-fabd-4292-a5eb-15866511f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0ea330-5916-40c3-b3ff-c3263e1f9d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:43 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Volume volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 (b82d6112-03fa-429a-bf1f-c974d2ac67b7): created successfully Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0ea330-5916-40c3-b3ff-c3263e1f9d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:43 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Flow 'volume_create_manager' (0f9f35ed-f021-44b2-a3b7-48f1f162decb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:43 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-e357c9ab-1338-4904-9235-6ea498ec3e20 tempest-ProjectReaderTests-567034268 None] Created volume successfully. Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Acquiring lock "cinder-b82d6112-03fa-429a-bf1f-c974d2ac67b7-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "cinder-b82d6112-03fa-429a-bf1f-c974d2ac67b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Acquiring lock "cinder-quobyte-b82d6112-03fa-429a-bf1f-c974d2ac67b7" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "cinder-quobyte-b82d6112-03fa-429a-bf1f-c974d2ac67b7" acquired by "delete_volume" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59c9292-6579-4352-aa94-e5340a4efa0a]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:44 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:44 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 Jul 09 01:36:44 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:45 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7" returned: 0 in 0.736s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:45 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7 Jul 09 01:36:45 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:45 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-b82d6112-03fa-429a-bf1f-c974d2ac67b7" returned: 0 in 0.654s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "cinder-quobyte-b82d6112-03fa-429a-bf1f-c974d2ac67b7" released by "delete_volume" :: held 1.427s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Created reservations ['f3225880-5c60-44ad-86d8-214bd41ceb42', '82f5514a-12da-4ac3-acee-d30db1bb0757', '504662c7-01a2-4e4f-a7bc-48c056e56543', '6b8880c1-47a8-43e4-9520-c06c6560ecce'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:45 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:45 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:45 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:46 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.672s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:46 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Deleted volume successfully. Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-eaa9d4cd-6272-4203-ae02-0266979e4f68 tempest-ProjectReaderTests-567034268 None] Lock "cinder-b82d6112-03fa-429a-bf1f-c974d2ac67b7-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86954) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Flow 'volume_create_manager' (a7a8c3a3-f3b8-4004-b626-d43813c4ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecea6f0-56be-41d3-9d59-e298be00dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecea6f0-56be-41d3-9d59-e298be00dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199157701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd013ea-eabf-4359-b168-bb000d7f812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a320f71f1dd7416dbc5fc27137cf21b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:47Z,use_quota=True,user_id='2f2f6793085d4afe92b4fbb5ad813777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9479406a-3875-4b2a-945e-025b8880c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:46 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9479406a-3875-4b2a-945e-025b8880c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c59c2-cc98-4605-9292-aee8fdb4e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c59c2-cc98-4605-9292-aee8fdb4e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd013ea-eabf-4359-b168-bb000d7f812c', 'volume_name': 'volume-4dd013ea-eabf-4359-b168-bb000d7f812c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8e6b6-13c2-479c-a441-318340abd29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8e6b6-13c2-479c-a441-318340abd29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88934605-0029-4eab-978b-44e4ae98c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:47 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Volume 4dd013ea-eabf-4359-b168-bb000d7f812c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd013ea-eabf-4359-b168-bb000d7f812c', 'volume_size': 1} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T23:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199157701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd013ea-eabf-4359-b168-bb000d7f812c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a320f71f1dd7416dbc5fc27137cf21b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T23:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T23:36:47Z,use_quota=True,user_id='2f2f6793085d4afe92b4fbb5ad813777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9471ef4d-ba95-4fe8-aadd-b884a6619bc0),volume_type_id=9471ef4d-ba95-4fe8-aadd-b884a6619bc0)}" {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.remotefs [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Creating volume 4dd013ea-eabf-4359-b168-bb000d7f812c {{(pid=86954) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Selected osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 as target Quobyte volume. {{(pid=86954) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 01:36:47 devstack cinder-volume[86954]: INFO cinder.volume.drivers.remotefs [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] casted to osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10 Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c 1073741824 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:47 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c 1073741824 Jul 09 01:36:47 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:47 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c 1073741824" returned: 0 in 0.783s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:47 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:47 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c Jul 09 01:36:47 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:48 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c" returned: 0 in 0.703s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'} {{(pid=86954) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88934605-0029-4eab-978b-44e4ae98c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd013ea-eabf-4359-b168-bb000d7f812c', 'volume_size': 1}' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93032687-0a4a-4165-8f77-d85193539e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 01:36:48 devstack cinder-volume[86954]: INFO cinder.volume.flows.manager.create_volume [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Volume volume-4dd013ea-eabf-4359-b168-bb000d7f812c (4dd013ea-eabf-4359-b168-bb000d7f812c): created successfully Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93032687-0a4a-4165-8f77-d85193539e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86954) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 01:36:48 devstack cinder-volume[86954]: DEBUG cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Flow 'volume_create_manager' (a7a8c3a3-f3b8-4004-b626-d43813c4ee09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86954) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 01:36:48 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-a75742da-18e1-4443-9243-567c3ec92af7 tempest-ProjectReaderTests-567034268 None] Created volume successfully. Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Acquiring lock "cinder-4dd013ea-eabf-4359-b168-bb000d7f812c-delete_volume" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "cinder-4dd013ea-eabf-4359-b168-bb000d7f812c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Acquiring lock "cinder-quobyte-4dd013ea-eabf-4359-b168-bb000d7f812c" by "delete_volume" {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "cinder-quobyte-4dd013ea-eabf-4359-b168-bb000d7f812c" acquired by "delete_volume" :: waited 0.013s {{(pid=86954) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e90489-72f6-49e8-b2bf-0a18ee199cf3]: (4, 'qcow2') {{(pid=88369) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:49 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c Jul 09 01:36:49 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:49 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c" returned: 0 in 0.738s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:49 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:49 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c Jul 09 01:36:49 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:50 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319/volume-4dd013ea-eabf-4359-b168-bb000d7f812c" returned: 0 in 0.642s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "cinder-quobyte-4dd013ea-eabf-4359-b168-bb000d7f812c" released by "delete_volume" :: held 1.418s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG cinder.quota [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Created reservations ['1097e1b6-df5c-4c62-9a28-fe6db2022fda', '245f030f-9760-49c3-95d0-8dd0b95b3796', '3c3aa838-1227-4ee8-b836-1c99273d2177', 'bdd6dccc-c50f-48bb-92a5-4f655896d3f0'] {{(pid=86954) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10': None} {{(pid=86954) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG cinder.volume.drivers.quobyte [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0d80c20-79a4-47ba-822e-503a8d6b9d10'] {{(pid=86954) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.lockutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86954) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 01:36:50 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 01:36:50 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319 Jul 09 01:36:50 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 01:36:51 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 09 01:36:51 devstack cinder-volume[86954]: DEBUG oslo_concurrency.processutils [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26b364f5e76a4e628724bca70baff319" returned: 0 in 0.649s {{(pid=86954) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 01:36:51 devstack cinder-volume[86954]: DEBUG cinder.manager [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Notifying Schedulers of capabilities ... {{(pid=86954) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 01:36:51 devstack cinder-volume[86954]: INFO cinder.volume.manager [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Deleted volume successfully. Jul 09 01:36:51 devstack cinder-volume[86954]: DEBUG cinder.coordination [None req-60dcfa56-f6f6-40d4-a9f1-72d4e6509f6b tempest-ProjectReaderTests-567034268 None] Lock "cinder-4dd013ea-eabf-4359-b168-bb000d7f812c-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86954) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 01:37:00 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 01:37:01 devstack cinder-volume[86954]: DEBUG dbcounter [-] [86954] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}